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There arc two w?/s to deal with students who show 
up for college without the rcquisite skills^o benefit 
folly from their instruction. The first is to ignorc their problems 
aiid teach them with the attitude that they'rc on their own: "If 
they can't make it in my class, that's just too bad!" This attitude 
prevails too often among college instructors; the results arc high 
student dropout rates and wasted potential. The second option is 
to rccognize the problem and deal with these students in con- 
structive ways: teach them the learning skills and strategies nec- 
essary to reap the full benefit of their college learning 
experiences. 

I he authors and editors of this volume, of course, advo- 
cate die teaching of learning strategies at the college level. Fur- 
thermore, they support such instruction mong all college 
students. They have reviewed the evidence carcfolly in order to 
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provide explicit and valid guidance on how to help college stu- 
dents improve their reading and study skills. 

Covering a range of topics from the nature of vocabulary 
acquisition and instruction to strategies for taking tests, these au- 
thors have written a book that is both scholarly and practical. 
They have— in all respects— thoroughly reviewed the literature 
on their respective topics and have identified the strategies that 
work for the teachers and for the learners. 

If you want to know how to increase student-initiated 
questions in your classes, this i& your book. If your students are 
overly anxious about tests, this is your book. If you need infor- 
mation about how to help students take notes, or about whether 
notetaking is even necessary, this is also your book. 

If I had the power to do so, I would place a copy of this 
book into the hands of every community college teacher; in- 
deed, into the hands of ever}^ teacher of college freshmen and 
sophomores. Rona Flippo, David Caverly, and their colleagues 
are to be commended. This book is excellent. 

AldenJ. Moe 
Lehigh University 
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Introduction 



The field of reading and study strategy improvement at 
the college level is as old as college itself. However, 
with the expansion of college enrollment after World War II and 
the rapid growth of junior and community colleges in the early 
1960s, college reading and study strategy instruction has gained 
new attention. Today, reading and study strategy assistance can 
be found in medical schools, universities, community and junior 
colleges, and technical schools around the world. 

During the widespread growth of college reading and 
study strategy instructional programs, we have learned a great 
deal. Until now, however, no one has made available a compre- 
hensive collection of knowledge about teaching and implement- 
ing readiiig and study strategy programs. This book provides a 
review of the theoretical, empirical, and instructional issues in 
the field of college reading and study strategies through a careful 
and systematic examination of the releva^n Uterature. 
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We had to make manv decisions 35 we developed this vol- 
ume. One decision was to limit ovr scope to college reading and 
study strategy instruction. Wlr'e many remedial and develop- 
mental college programs include components in adult basic edu- 
cation, English as a second language, writing, mathematics, and 
counseling, we chose not to discuss these related but separate 
areas. 

Another decision was what to call the programs we did 
include and the personnel teaching or directing them. These pro- 
grams have a variety of labels, including college readiiig and 
study skills, college reading improvement, learning strategies, 
special studies, developmental or remedial instruction, basic 
skills instruction, and compensator) education. Personnel in this 
field are collectively called reading !)pecialists, reading practition- 
ers, or learning specialists; they can be college reading program 
directors, administrators, staff infitructors, professors, teachers, 
or counselors. We chose not to force conformity on our authors, 
since all these labels and titles are used in the field. We let the 
authors of each chapter decide on the labels that seemed to fit 
besc with their orientation and f:xperience. 

A third decision was the organization of the chapters. We 
sought cumprehen:,ivcness and some organizational conformity. 
We asked the authors to approach their chapters in a way that 
seemed appropriate to their topics and writing style, but to in- 
clude four general components. (1) an introduction and rationale 
for their topic; (2) a review of the relevant literature; (3) a synthe- 
sis of this literature, including a discussion of implications, rec- 
ommendations, and further avenues of research, and (4) a 
bibliography of references and suggested readings. We asked the 
authors to indicate the most relevant works in this list b> noting 
them with an asterisk (*). 

In Chapter 1, Simpson and Dwyer begin by reviewing vo- 
cabulary instruction and discussing what it means to know a 
word, how such kn(>wledge can be measured, and the role of the 
student in learning new words. They follow with a critique of 
studies that focus on strategies for developing both general and 
content-specific vocabulary, and conclude with the characteris- 
tics of effective vocabulary instruction. 
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Nist and Mealey review the more teacher-directed com- 
prehension strategies in Chapter 2. Building from a review of cur- 
rent theoretical bases for college reading instruction (e.g., 
metacognition, schema theory, text structure), they discuss the 
effect of dhm comprehension instruction on college-age read- 
ers. Next, they review the research on various compre'iension- 
building techniques. They end with specific recommendations 
for teaching comprehension strategics. 

In Chapter 3, Caverly and Orlando revie^y student- 
initiated strategies for studying college-le/el textbooks. , As a 
framework for discussion, they present a historical overview of 
comprehension theories, moving from the product perspective 
to the process perspective to our currcii .nteractive perspective. 
Then thf-y rc\iew current models of texiDOoL studying and the 
empirical research in support of such models. The chapter ends 
with recommendations for teaching textbook study strategies to 
college-age readers. 

AiTdeirson and Armbruster begin Chapter 4 with a re>iew 
of the literature on taking notes during icctures. Using both the 
external storage hypothesis and the encoding hypothesis put 
forth to explain the effects of notctaking, they discuss the impli- 
cations of research for instruction in notetaking at the college 
le\'el. 

In Chapter 5, Rislio, Alvarez, and Fairbanks review the lit- 
erature on time management, study environment, and library 
use. They examine the recommendations of study strategy text- 
books and the correlation between these recommendations and 
the empirical literature, concluding with specific implications for 
teaching study strategies. 

Risko, Fairbanks, and Alvarez re\'iew what the study strat- 
egy textbooks recommend regarding motivation, memor>' en- 
hancement, and students' attention in Chapter 6. Again, they 
examine the correlation between these recommendations and 
the empirical literaturc and end with implications for instruc- 
tion. 

In Chapter 7, Wark and Flippo discuss study strategies for 
test preparation and test taking. Specifically, the)' r2\1ew the liter- 
ature on test coaching, test wiseness, and the treatment of test 
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anxiety. They close with suggestions for instn'Ction and future 
research. 

We believe you will find this publication the most com- 
prehensive and up-to-date source available in the field of college 
reading arid study strategies. While several excellent books ad- 
dress i;imilar topics for elementary or secondary school popula- 
tions, this is one of the firjt books to thoroughly examine reading 
and study strategy instruction at the college level It is intended 
to provide specific and necessary information to a diverse audi- 
ence, including practitioners who arc looking for ready answers, 
administrators who are intereiied in developing relevant and 
beneficial prognuns, and professors who are training students in 
coUege reading and study strategies without the benefit of a text- 
book or a compilation of readings. Tliis volume also should be of 
interest to reading educators, researchers, and librarians who 
want to add a comprehensive review of the litencure in this area 
to their collections. 

RFF 
DCC 
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VocabuXary 
Acqjulsition 
and the College 
Student 

Michele L. Simpson 
Edward J. Dwyer 



The subject matter to be mastered in most content-ori- 
ented college courses includes discipline-specific and 
often highly technical vocabulary with numerous underlying 
concepts (Hopper & Wells, 1981; O'Rourke, 1974; Sartain e. al., 
1982). To guarantee successful independent learning, college stu- 
dents need well-developed receptive vocabularies— that is, 
words that are known when either heard or read (Manzo & 
Sherk, 1971-1972} They also need effective and efficient strate- 
gies for coping with previously unknown words. Many students, 
however, possess neither the receptive vocabulary nor the strate- 
gies necessary to cope with the demands of independent learn- 
ing in col'ege. 
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While this lack is often cainoutiaged by students who di- 
agnose their difficulties in a course as solely content related, Sa*- 
tain et al. (1982), in a 2-year study tracing the learning difficulties 
of college students, found some very intriguing patterns. Stu- 
dents enrolled in four core courses (philosophy, physics, psy- 
chology, and English composition) were asked to keep logs and 
attend weekly seminars conducted by graduate assistants to dis- 
cuss the problems they were having in their classes. During those 
2 years, the mooC comnx n difficulty reported by students across 
all four content areas was technical vocabulary. (Hopper and 
Wells [1981] reached similar conclusions in a study involving 
600 college students.) Sartain et al. also reported that inadequate 
general vocabulary development Avas a major obstacle to success 
in the college couri>es studied. If the vocabulary demands of 
these four content areas were representative of the demands of 
other college courses — and if student leports were typici . and 
accurate— it is evident that general and technical vocabulary defi- 
ciencies are major causes of difficulty vviih course content. 

Since an extensive vocabulary and a well-dc*veloped rep- 
ertoire of strategies for improving vocabulary are critical for suc- 
cess In content area learning, college reading professionals need 
to use systematic and effective approaches to vocabulary instruc- 
tion. Interestingly enough, such appr ^'ches have yet to be ade- 
quately defined for any age level. Reading teachers must help 
students learn vocabulary that is directly related to content- 
oriented material. On the other hand, the long-range goal of a 
vocabulaiy program must be to provide students \/ith the means 
to develop vocabulary on their own— particularly si.nce it is un- 
likely that college teachers will provide vocabul sy instruction 
along wiih course content instruction. Thus, the purpose of this 
chapter is to review current research with the goal of developing 
practica. guidelines for implementing efiectiv^ vocabulary en- 
hancement approaches and strategies. 

Theoretical and Methodological Issues 

Several theoretical and methodological issues have been 
explored through research, either explicitly or implicitly, to de- 
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tennine a superior method of vocabulary instruction. These is- 
sues are similar to those that classroom teachers face 
daily— whether in middle school, high school, or college— 
when they make decisions concerning the types of instruc- 
tional activities and forms of assessment to use with students. 
For example, one troublesome methodological issue for both 
researchers and classroom teacher: is how best to measure 
whether students have learned the words they were taught. If 
the teacher/researcher selects a format to measure vocabulary 
growth that matches the instruction, he or she cannot reliably 
tell from the test scores whether the students really learned the 
words that were taught or whether they merely demonstrated 
effective test-taking skills. Further, such evaluations involve 
only recognition, which tells nothing about students' ability to 
use words in course contexts or to generate material of their 
own using a particular word. Thus, the real impact of vocabu- 
lary instruction becomes obscured *^y the selection o^" the test- 
ing instrument, causing the teacher/researcher to make tenuous 
conclusions about the effectiveness of the instruction. 

While these issues may seem to be somewhat routine, 
their impact on the results of various vocabulary studies has 
been significant (Fairbanks, 1977; Mezynski, 1983; Vaughn et 
al., 1981). Therefore, three of the most critical issues will be 
discussed in tiiis section: the criteria for knowing a vocabulary 
word, the type of assessment procedure, and the role of the 
learner. 

What Does It Mean to "Know'' a Word? 

What factor determines whether a student has learned a 
new word? That question is difficult to answer because most 
research supports the conclusion that word meanings become 
progressively differentiated as learners age and become more 
experienced. Word knowledge is not a static product but a fluid 
quality that takes on additional characteristics and attributes as 
the learner experiences more associations with the word. Sev- 
eral models, however, have attempted to describe the levels of 
word knowledge through which a learner progresses. 
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Dale's (1965) continuum-concept model is one such at- 
tempt. He suggested that word knowledge follows four stages: 
(1) IVe never seen the word; (2) I've heard of it, but I don't 
know what it means; (3) I recognize it in context, it has some- 
thing to do with...; and (4) I know the word in one or several of 
its meanings. Dixon and Jeakinb's (1984) analysis of receptive 
vocabulary knowledge is similar to Dale's in that a continuum is 
emphasized. They break down the levels of knowledge into full 
concept, partial concept, and verbal association knowledge. 
Most classroom teachers would say that full concept knowledge 
is their goal for vocabulary instruction. 

For the purposes of this chapter, full concept knowledge 
is defined as being attained v/hen students can recognize exam- 
ples of the targeted concepts without teacher assistance, and 
when they can discriminate between the use of a particular con- 
cept and similar examples drawn from other concepts. Con- 
cepts can be fully defined by a set of critical features (those 
common to all examples) and variable features (those demon- 
strated by some examples but not all). When a student's knowl- 
edge of a concept consists of any of the various combinations 
of such features, that student has partial concept knowledge. 
Obviously, partial knowledge exists in several degrees. A stu- 
dent's verbal association knowledge is not an indication of con- 
cept knowledge; rather, it is the pairing of a label to its meaning, 
a one-dimensional rote activity. 

With such a perspective of word knowledge, the issue is 
not whether students know the word but in what way they 
know the word. Dale (1965) and Dixoa and Jenkins (19S4) im- 
ply that it is best for students to know a new word as a fuil 
concept, especially if knowing the word can have a substantial 
impact on subsequent understanding and learning. 

For whatever reason, researchers rarely strive with their 
subjects for the full concept dimension of word knowledge. 
Moreover, only a few researchers have explicitly stated their cri- 
teria for word knowledge (Beck, Perfetti, & McKeown, 1982; 
Stahl, 1983), whereas the majority have depended on their as- 
sessment instruments to create that criteria implicitly. Conse- 
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quently, the type of vocabulary assessment used in research or 
in the classroom becomes critical to the entire process since it 
can lead to the formation of instructional goals. 

How Can Vocabulary Knowledge Be Measured? 

The type of instrument used to measure vocabulary ac- 
quisition should be closely related to the researcher/teacher's 
concept of what is involved in knowing a word anr sensitive to 
what is being attempted via the instruction (Kameenui, 
Carnine, & Freschi, 1982). It this sensitivity is lacking, there is a 
strong possibility that the measurement will mask or understate 
the instructional strategy's effectiveness. For example, if a mul- 
tiple choice test is used to measure the effectiveness of an in- 
structional lesson that emphasized word classification or 
categorization, some students may do poorly on the test be- 
cause the instruction did not focus on the strict memorization 
of definitions. If, however, the researcher selects an analogy test 
format, the students will be better able to demonstrate ^hat 
was learned. 

Objective and recall assessment procedures have distinct 
advantages and disadvan:ages tha neeu to be acknowledged. 
Earlier studies with college students tended to rely heavily on 
standardized tests with a multiple choice format (Alexander, 
1969). More recent studies (Diekhoff, Brown, & Dansexau, 
1982) tend to use free recall assessment measures such as short 
answer questions or modified cloze procedures. This trend may 
be indicative of how researchers are defining what it means to 
**know" a word. 

Researchers need to more carefully define which level of 
word knowledge they wish to stress, select vocabulary strate- 
gies that will help .students learn at that level, and then create a 
test that will be sensitive to the effects of that instructional strat- 
egy. Unfortunately, researchers have not been consistent 
in th^^ir procedures, thus causing some unwarranted conclu- 
sions to be drawn about the effectiveness of certain vocabularj' 
strategies. 
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What Is the Student's Role in Vocabulary Acquisition? 

The third methodological/theoretical issue concerns the 
role of the learner during vocabulary instruction. This critical 
area involves efforts to determine whether the learner is seen as 
a passive recipient of knowledge or an active seeker of informa- 
tion. The activity of the learner has been theoretically defined 
by Craik (1979) and Craik and Lockhart (1972), who proposed 
that deeper, more elaborate, and distinctive processing of stim- 
uli results in better performance, all other things being equal. 
(Deeper proce:jsing is typically semantic in nature, whereas su- 
perficial processing is acoustic or visual.) Because the levels of 
processing model has been criticized (Eysenck, 1979), other re- 
searchers have suggested modifications. For example, Tyler et 
al. (1979) proposed that the amount of cognitive effort required 
by a task is an important determinant of later recall perform- 
ance, with greater c ^gnitive effort leading to greater recll. Cog- 
nitive effort research with college-level learners (Craik & 
Tulving, 1975; Hyde & Jenkins, 1973; Johnson-Laird, Gibbs, & 
deMowbrey, 1978) supports this concept. 

Within these theoretical frameworks, which are specula- 
tive, vague, and difficult to quantify, Stahl (1985) attempted to 
describe the tasks of the learner. He suggested that, depending 
on the instructional methods used, a student learning new vo- 
cabulary should be involved in associative processing, compre- 
hension processings, or generative processing. Associative 
processing requires the learner to make an association or con- 
nection between a word and its synonym or definition within a 
particular context. This level of activity might involve the learn- 
ers in dictionary study or programmed learning. Associative 
processing is the lowest leve' of involvement, requiring the least 
amount of processing (Craik, 1979; Craik & Lockhart, 1972) 
and the least amount of effort (lyier et al., 1979), but it is the 
basis for the next two levels of processing. 

The second level, comprehension processing, requires 
the learner to apply word association > to a new situation in a 
meaningful and correct ^ nner. The learner could be asked to 
complete analogy or categorization exercises, fill in the blanks 
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in cloze ecercises, or judge whether a word has been used cor- 
rt.uy. For example, in a study by Beck, McCaslin, and 
McKeowo (1980), some of the subjects were asked to 
answer nnestions using targeted woras rather than simply told 
the definitions by the teacher. 

The third level, generative processing, asks the learner to 
create or generate a novel context for the targeted word. This 
task could require the learner to write original sentences, to 
paraphrase definitions, or to create categories or 5>emantic 
maps. 

When researchers compare different vocabulary strate- 
gies to determine which is more effective, they often fail to 
define adequately or to keep equivalent the processing require- 
ments (or involvement) of the learners (Mezj^nski, 1983). Con- 
sequently, a strategy that actively engages the learner in soh'^ng 
^toblems, answering questions, or producing applications in 
aew situations may be compared directly with another strategy 
that asks the learner to fill in blanks or to match words with 
definitions. Not surprisingly, the more active strategy involving 
the learner in generative processing appears to be the superior 
method of vocabulary instruction. 

Researchers must thoroughly address the issue of proc- 
essing levels, as well as issues pertaining to the criteria for deter- 
mining whether a word is known and the methods of assessing 
vocabulary instruction, before they draw conclusions about the 
effectiveness of particular vocabulary strategies. This is abso- 
lutely essential if research is to contribute to the improvement 
of vocabulary instruction in the college classroom. 

Review of Empirical Literature 

Within the past 5 years, interest in vocabulary study has 
increased tremendously. iMost recent studies have focused on 
intermediave-aged students, leaving college reading profession- 
als with little direction. Through an extensive survey. Berg, 
Hess, and Crocker (1983) found that only l4 percent of college 
reaJing teachers were able to find relevant research to warrant 
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teaching vocabulary in courses designed to help students im- 
prove in reading competence. This finding is not comforting 
considering the multitude of commercially available vocabu- 
lary workbooks and kits, none of which appear to be empiri- 
cally based (Stahl, Brozo, & Simpson, 1987). There is, however, 
a small body of recent research on how college students learn 
words that can provide reading professionals with some guid- 
ance. These studies, most of which were conducted within the 
past decade, can be divided into two categories: general vocab- 
ulary development studies and content-specific studies. 

General Vocabulary Development Studies 

Practitioners and researchers who believe that system- 
atic instruction should focus on general vocabulary improve- 
ment probably favor the instnimentalist position outlined by 
Anderson and Freebody (1981). The instrumentalist hypothesis 
maintains that word knowledge is a direct causal link affecting 
text comprehension. Thus, the more individual word meanings 
taught, the better students will comprehend any new or diffi- 
cult expository material they read. Anderson ind Freebody 
stressed that the most distinguishing characteristic of the instru- 
mentalist hypothesis is the emphasis on direct vocabulary- 
building exercises. 

Research focusing on the development of general vocab- 
ulary among college students reflects a gradual change over 
time relative to the issues of which words should be taught, 
how students should be taught the targeted words, and which 
measures should be used to assess the effectiveness of vocabu- 
lary instruction. Studies from the late 1960s and early 1970s 
tended to emphasize master word lists, with words taught by 
repetitive associations with synonyms or brii,f dictionar)' defi- 
nitions, standardized reading tests were used to measure vocab- 
ulary acquisition. In contrast, studies in the late 1970s and early 
1980s emphasized more active and generative strategies, words 
taught within context, and informal assessment procedures. 

Because of the vast methodological differences in earlier 
and later general vocabulary improvement studies, it is not sur- 
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prising that the findings tend to be highly equivocal. Neverthe- 
less, we will make an effort to systematically analyze these 
general vocabulary improvement studies. These studies were di- 
vided into seven subcategories: word list, word part.(affix), key- 
word/imagery, experience-based, contextual analysis, mixed 
method, and student-initiated learning studies. 

Word If'st studies. Teaching vocabulary from a list is per- 
haps the oldest and most prevalent instructional method in sec- 
ondary' and postsecondary education. In experimental studies 
using word lists, subjects receive a list of words and their defini- 
tions/synonyms or are told to consult a dictionarj' for compre- 
hensive definitions. The words to be learned generally come 
from commercial workbooks, standardized tests, or high- 
frequency word lists. Both the control group (usually with no 
instruction) and the experimental group arc given a standard- 
ized test to measures the effects of the instruction. In general, 
these types of studies, conductea in the 1950s and 1960s, 
found no significant differences favoring the subjects who used 
word lists to improve their general vocabularj' (Crump, 1966, 
Fairbanks, 1977; McNcal, 1973). 

Affix studies. Unlike word list instruction, t^eaching 
word parts, or affixes, is a generative strategy that allows stu- 
dents to unlock the meaning of at least some of the unknown 
words the}' encounter. Teaching affixes has been widely rccom- 
mended for all ages and levels of students (Cushenberrj; 1972; 
Dale, 1965; Dcighton, I960; O'Rourke, 1974). In fact, this 
technique might be considered a college reading tradition. Of 
the 55 vocabulary workbooks analyzed by Stahl, Brozo, and 
Simpson (1987), 44 (80 percent) heavily emphasized word 
parts. However, little empirical research exL^^ts at any age level 
to support «:he teaching of affixes as a metnod of developing 
general vocabulary (Graves & Hammond, 1979). 

We found only three empirically based studies that fo- 
cused on using affixes with college students. Albinski (1970) 
found that the preteaching of affixes was effective with a group 
of 37 college students. On the other hand, he did not consider 
the advantap^es great enough to warrant teaching word stems on 
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a routine basis. Einbccker's (1973) study with junior college 
freshmen compared three different methodologies for teaching 
40 different words. Group one was simply directed to study the 
words, group two was instructed to note and look up root 
words, ^nd group three watched an audiovisual presentation of 
root worUb and their uses. On the 40-word posttest, the three 
groups showed no significant differences in their ability to rec- 
ognize word mcaning5 

In the third study focusing on college students, Strader 
and Joy (1980) compared three distinctly different vocabularj' 
teaching methods, one of which involved highly structured les- 
sons on 60 Greek and Latin prefixes, suffixes, and roots. On the 
vocabuljiry section of the Nelson-Denny Reading Test (Brown, 
Nelson, & Denny, 1976), therc were no significant differences 
in performance acn^ss the three groups. However, on the other 
dependent measure— a researcher-made 30-item multipl-* 
choice test assessing the ability to combine forms— the group 
receiving the highly structured affix instruction performed sig- 
nificantly better than the other two groups. 

On the theoretical level, student knowledge of affixes as 
a generative strategy for unlocking the meaning of t>ew words 
has some appeal. On the other hand, the lack of empirical re- 
search supporting this practice invites caution. Future research- 
ers should carefully design their dependent measures to be 
sensitive to instruction on affi^xes. They also should build into 
their instructional paradigm some transfer lessons, as Graves 
and Hammond (1979) did. Unlike Graves and Hammond, the 
researchers in the three studies described did not seem to pro- 
vide students with the guided instruction necessary to transfer 
their knowledge of affixes to unlock difficult words in their 
persoHcd reading. Further, it is unlikely that isolated drills on the 
meanings of affixes will increase a student's general vocabular); 
although empirical research has not verified this conclusion. 

Keynvord/imagery studies. During the past 5 years, con- 
siderable interest and research have focused on a mnemonic 
strategy called the keyword method, which was originally de- 
signed for learning a foreign language (Raugh & Atkinson. 
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1975). In this strategy, students arc trained either to find a key- 
wora 01 clue within the unknown target word and then de- 
velop a mental image of that kej^word or to use the keyword 
and menial image provided by the researcher/trainer. A varia- 
tion of this method asks the learner to place the ke>'word and 
definition in a meaningfiil sentence. For example, if the target 
word to be learned was acrophobia^ a student might focus on 
the clue of aero and then develop the image of an acrobat who 
was afraid of heights walking on a (ightrupe high in the sky. The 
learner could then generate a sentence such as: The acrobat, 
who nas always been afraid of high places, suffered trom acro- 
phobia. 

Paivio (1971) stated that mental imager)' is important in 
facilitating long term retention for adults because of the dual 
coding of organizational factors. Advocates of the dual-coding 
theory maintain that two different but interconnected symbolic 
processing systems exist for encoding information— one verbal 
and the other nonverbal. They propose that information is en- 
coded in verbal, nonverbal, or both systems depending on the 
task and the concreieness or abstractness of the words read. Ab- 
stract words are more likely to activate verbal corlings and con- 
crete words are more likely to activate either nonverbal codings 
or a combmation of both verbal and nonverbal systems. Other 
researchers have suggested that the associative imagerj of the 
keyv/ord mnemonic operaiv., by linking or relating items so 
they form unified wholes or higher order units. Thus, when 
one item is recalled, that item aci^ as a retrieval cue for the 
other items to regencnue the whole (Begg, 1972, 1973; Bower, 
1970. 19''2). 

There is some evidence to sugge5t that when college stu- 
dents invent or discover their own images the>' retain more than 
when they are pro\ ided wi*h the image*^ (Bobrow & Bow^'r, 
1969). It appears that self-induced images are superior to re- 
searcher/trainer-induced images because learners arc morc ac- 
tively involved when they generate the images and, 
consequently, are able to rclate the images Ko their own way of 
thinking and their own experiential backgrounds. 
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Often the target words in keyword research are words 
with extremely low frequency (e.g., bolter, cowry, hosel, ra- 
tine). In this light, a hypothesis proposed by Eysenck (1979) ex- 
plains, in part, why laudents trained in the keyword mnemonic 
almost always seem to perform significantly better than stu- 
dents in a corresponding control group. Eysenck 's experiments 
demonstrated that rare words (such as those typically utilized in 
kej'word research) are more distinctly encoded than common 
words and tend to be remembered more easily. 

in addition to theoretical explanations supporting the 
keyword method, several studies with college students demon- 
strate this method's effectiveness. Pressley, Xevin, and Miller 
(1^61) conducted four experiments with college-age students 
designed to determine how the keyword method affects con- 
textual measures of vocabulary acquisition. These studies were 
developed in response to criticism that the keyword method 
overlooks comprehension and usage and focuses only on sim- 
ple associatic s between words and definitions. Critics of the 
method were answered, at least in part, when in these four 
studies the subjects using the keyword method performed sig- 
nificantly better than the control group on the dependent 
measure. 

Reacting to criticism that the keyword method had 
never been compared with alternative vocabulary learning strat- 
egies, Pressley, Levin, and Miller (1982) conducted a second set 
of experiments. In these studies, three groups of subjects were 
mstructed in the verbal-contextual approach to vocabulary in- 
struction, while three other groups were instructed in the key- 
word method. The scores of the ke)'^word groups were superior 
to those of the three verbal-contextual groups and to those of a 
control group that received no instruction, regardless of how 
the definitions were scored. Even more interesting was the find- 
ing that none of the contextually based groups scored better 
than the control group. 

While Pressley, Levin, and Miller (1982) conducted their 
stud) with regularly enmlled students in college-level introduc- 
tion to psychology courses, Roberts and Kelly (J 985) studied 

27 

Simpson and Dwyer 




students in college developmental reading classes. Their study 
compared the keyword method with a treatment condition us- 
ing dictionary definitions. Roberts and Kelly found only mod- 
est differences favoring their keyword method in an immediate 
recall test; however, they found much greater differences favor- 
ing the approach on a measure of delayed recall. In a more re- 
cent study, Smith, Stahl, and Neel (1987) reported similar 
findings. 

Although the findings appear impressive, keyword 
method studies do have some limitations. The most evident is 
the lack of applicability to actual classrooms. The words that 
college reading teachers select to teach their students typically 
are not like those used in the keyword studies. Keyword re- 
searchers usually use concrete, three syllable, low -frequency 
nouns with concise definitions (Pressley, Levin, & MiUer, 1981, 
1982). Researchers in future studies must >e target words that 
college students need to know in order to understand what 
they read and hear, not words that are judged to be conducive 
to the keyword method. 

Another limitation to keyword studies is whether col- 
lege students can and will transfer the keyword system to their 
own learning tasks, A literature review reveals that only Jones 
and Hairs (1982) study with eighth graders attempted to an- 
swer that question. Furthermore, only Jones and Hall tried to 
apply the kq^word method to an actual classroom setting. CoN 
lege reading researchers need to follow this example and apply 
the keyword method in a realistic setting to answer the ques- 
tion, "What would happen if college students were given a list 
of words without the corresponding keywords and asked to 
learn the words as efficiendy as possible for application in a 
specific task?" Despite limited empirical support, the keyword 
method holds cor^iderable promise, especially when compared 
with traditional and passive riethods of vocabulary '-velop- 
nient that require no more of me learner than the memorization 
of a diaionary definition. 

Experience-based studies. The basic assumption in the 
experience-based approach is that students can best understand 
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and remember new vocabulary after they have developed or en- 
hanced their background for the concept the word represents. 
Manzo (1982) suggested that the teacher can enhance a stu- 
dent's background through the provision of on-the-spot experi- 
ences with follow-up dtscussions. Tblving (1983) suggested that 
this type of experience can become a part of a student's epi- 
sodic memory — that is, memory for events. TUlving's theory 
suggests that vocabulary acquisition must begin in the episodic 
memory. Once additional contexts for a word are learned, the 
word, with all its related contexts, becomes a part of the seman- 
tic memory— the memory for general meanings that can be ap- 
plied in numerous situations. This is th'* ultimate goal of most 
vocabulary instruction. 

Petty, Herold, and Stoll (1968) concluded from a review 
of 50 different vocabulary' studies that providing for experience 
in using a word is extremely important in a learner's vocabulary 
acquisition. Few researchers, however, have experimentally ex- 
plored this concept with college learners. In the one study 
found in this area, Duffelmeyer (1980) reported positive results. 
Duffelmeyer tested the impact of providing experiences with 
new vocabulary by requiring 56 college students to act out in- 
vestigator-prepared skits. Tht skits were built around words 
taken from passages in the comprehension section of the Nel- 
son-Denny Reading Test. After each dramatization the investiga- 
tor asked the class several questions about the targeted word. 
Then the studenis were asked to volunteer a personal experi- 
ence that would convey the meaning of the word. The subjects 
in the comparative group used a traditional approach that em- 
phasized context clues, structural analysis, and dictionary use. 
The experience-based group significantly outperformed the tra- 
ditional group on the exam, supporting Duffelmeyer's hypothe- 
sis that college students can benefit from an experience-based 
approach to general vocabulary growth. 

More research on this approach should be conducted 
with college-age students. Of particular interest would be at- 
tempts to validate student-centered approaches like Haggard's 
(1982) self-collection strategy or Manzo s (1982) subjective ap- 
proach to vocabulary (bAV) strategy. Both Haggard and Manzo 
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emphasize the role of student involvement in selecting the words 
to be learned and the importance of strong initial experiences. 

Contextual analysis studies. The use of context clues 
for vocabulary improvement has long been highly recom- 
mended because of its purported advantages over other sf ate- 
gies. The theory is that students need not be dependent on a 
dictionary or glossary; instead, they can ineependently apply 
context strategies when confronted with unknown words. 
Consequently, many secondary and postsecondary reading 
method textbooks instruct teachers to tell their students to use 
contextual clues when they come across a word they do not 
know. Most commercial vocabulary materials for college stu- 
dents emphasize the use of contextual analysis. 

Whether contextual arialysis can actually help studen.^ 
understand difficult or unknown words and whether contex- 
tual analysis has a long term effect on vocabulary acquisition 
are issues still being researched and debated. For example, the 
results of Nagy et al. s (1984) research with eighth graders sup- 
port the hypothesis that students do increase general vocabu- 
lary via contextual analysis. Providing further support for 
contextual analysis, Stahl and Fairbanks (1986) concluded 
from a review of 26 studies (25 percent with college students) 
that emphasis on contextual information is more effective 
than emphasis on definitions. On the other hand, Schatz and 
Baldwin's (19 ^^6) study with eleventh graders found that the 
use of context clues with low-frequency words had no signifi- 
cant effect on subjects* performance. 

Little research his been undertaken with college-age 
learners, but the limited research that does exist supports the 
use of contextual analysis. These studies have attempted either 
to describe Cue types of context clues that college students use 
or to experimentally measure the benefits of learning a word in 
context as opposed to learning a word and its definition in iso- 
lation. Reith (1981) reported that in choosing from among sev- 
eral types of context clues, college freshmen found the linked 
synonym clue to be the easiest to use and the comparison-con- 
trast clue to be the most difficult. 
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An extensive review of the research led Gamine, Ka- 
meenui, and Coyie (1984) to conclude that instructional strate- 
gies for teaching students how to use context clues have not 
been well defined. However, Ironside*s (I960) study with 211 
college subjects is noteworthy because this researcher at- 
tempted to define an instructional paradigm that could be used 
effectively when teaching context clues. The Ironside study 
used three different experimental treatments: (1) deductive les- 
sons — lectures on the types of context clues, (2) inductive les- 
sons — 100 practice exercises with no clue names, and (3) 
combination lessons— 100 practice exercises and lectures on 
clue types. After 7 hours of instruction, the subjects in each 
group read a 1,000-word article coniaining 31 nonsense words 
that had to be defined on the basis of context clues. Each group 
then retook a standardized reading test to measure gains in read- 
ing power. All groups made gains, but there were no significant 
differences among the treatment groups. 

Bobrow and Bower (1969) concluded that semantic en- 
coding could strongly facilitiite associative learning. Anderson 
and Kulhavy (1972) decided to build on this research and deter- 
mine whether semantic encoding would have a similar effect 
on conceptual learning. They tested to see whether college stu- 
dents who saw a word and its definition and then created a sen- 
tence using the word would learn more than students who saw 
the word and its definition and then merely read the definition 
aloud three times. When the groups were compared on a vocab- 
ulary measure, the subjects who composed their own sentences 
did significantly better than those who read the definitions 
aloud. These findings are not surprising given the difference in 
the two groups' level of active involvement in the exercise. 

Crist and Petrone (1977) conducted a study similar 
to that of Anderson and Kulhavy (1972), but their subjects did 
not generate sentences. The researchers found that the context 
group not only performed significantly better on the context 
posttest, but also performed as well as the definition group on 
the definition posttest. Crist 1,1981) replicated the Cilai and Pe- 
trone study but used a single subject design. His results con- 
firmed the earlier study's findings. 
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While the research looks promising for the use of con- 
textual analysis with college students, it has evident limitations. 
For example, in the studies by Anderson and Kulhavy (1972), 
Crist and Petix)ne (1977), and Crist (1981), the subjects were ex- 
posed to short, researcher-constructed passages that were dif- 
ferent from the naturally occurring expository text th at college 
students read. Thus, the only credible conclusion is that contex- 
tual analysis helps college students learn word meanings (as 
measured by a test shortly following instruction) from re- 
searcher-made instructional sentences. Whether it helps them 
learn the meanings of unknown words found in more typical 
expositor)^ text is a question yet to be answered. 

In attempting to answer this question with eleventh 
grade students, Schatz and Baldwin (1986) found the use of a 
context clues system ineffective in helping students determine 
the meanings of low-frequency words in natuiilly recurring 
prose. Considering these findings, replicat.on of this study with 
college students seems advisable. 

A second critical limitation is that researchers' criteria 
for knowing a word generally appear to be less comprehensive 
than criteria normally set by teachers. Teachers want their stu- 
dents to be able to derive meaning from unfamiliar words in 
sentences and i>::-%jgraphs and to be able to use these words in 
future situations O^nkins & Dixon, 1983). Researchers tend to 
be far less specific. 

Another limitation is that little attempt has been made to 
define the instructional methodology involved in teaching stu 
dents to use context clues effectively. Only Ironside (I960) 
appears to have addressed this issue directly and comprehen- 
sively. Research rs thus far have provided college reading teach- 
ers with Hrtie direction in the effective instruction of 
vocabulary using context clues. On the other hand, when 
Carnine, Kameenui, and Coyle (1984) attempted to address that 
ibsue with intermediate grade students, they found that the e> - 
plicit teaching of a contextual analysis rule (e.g., ''when there ib 
a hard word in a sentence, look for other words in the story 
that tell you more about the word") was not particularly help- 
ful. 
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Researchers using contextual analysis with college-age 
students need to examine the use of operational rules, the use 
of immediate feedback, and the quantity and pacing of practice 
exercises. Such analysis could lead to the eventual development 
of effective strategies for teaching students how to use context 
clues to understand the meaning of unfamiliar words. 

Overall, many unanswered questions remain in the area 
of contextual analysis. As a beginning, researchers should exam- 
ine four issues: 

• the generalizability of contextual analysis to naturally 
occurring prose across a variety of content areas; 

• the effects of contextual analysis on all types of read- 
ers, especially poor comprehenders; 

• tht long term effects of contextual analysis on differ- 
ent levels of word knowledge; and 

• the role of the teacher in the instructional process. 

Mixed method studies. Several studies with college-age 
students have used a mixture of methods and have emphasized 
both definitional and contextual knowledge of targeted words. 
When Petty, Herold, and Stoll (1968) reviewed existing vocabu- 
lary studies they found that methods involving a number of dif- 
ferent teaching strategies were more effective than any one of 
those strategies used alone. 

Johnson and Stratton (1966) carefully defined their in- 
structional methods so that four discrete treatments (defini- 
tions, sentences, classification, and synonyms) could be 
compared with a mixed treatment that contained elements of 
each of the other four A sixth group, designed as the control, 
received an irrelevant treatment. The treatment for each of the 
groups lasted a total of 12 minutes. Nine days later the 200 sub- 
jects were given two tests with open-ended and multiple choice 
questions. The group that received the mixed treatment got 
higher total scores than any of the groups that received a single 
kind of training. Ther were no significant differences among 
the four groups that received one kind of training. However, all 
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five groups that received relevant a"catments did better than the 
control group. 

Like researchers working with younger students (Gipe, 
1979; Stahl, 1983), Johnson and bcxUtton found that when a sin- 
gle method is specifically dehnfd and then compared with a 
combination of methods, the v^ombined method yields superior 
results. Several factors explain why Johnson and Stratton found 
this to be true when other researchers (Alexander, 1969; Baer, 
1974) did not. First, Alexander and Baer compared one mixture 
with another mixture, thus reducing the impact of any one of 
the methods. Moreover, they used standardized tests to measure 
the effects of their treatments, while Johnson and Stratton con- 
structed their own more sensitive tests. Further research based 
on the Johnson and Stratton study is needed; such research 
should be designed to examine the long term effects of each 
instructional methodology. 

Student-initiated learning studies. Some researchers 
propose that a learner's general vocabulary increases more 
when the motivation is intrinsic than when it is extrin- 
sic (Goodman, 1976; Haggard, 1980, 1984; Herber, 1978). 
Haggard concluded from her research on vocabulary acquisi- 
tion that during their elementary and secondary years students 
tended to learti new words because the words had some imme- 
diate Usefulness or particular significance. She later replicated 
the study with college-age students to determine if the same 
motivations for learning new words existed. Over a 6-weck per- 
iod, 42 college sophomores and juniors logged their own vo- 
cabulary development in a journal. The most commonly cited 
reason for learning new words was to be able to use them im- 
mediately in order to be more successful in class. The second 
most commonly reported reason for selecting a particular word 
was the need to clarify meaning. Of the total number of words 
learned, 40 percent were related to courses the students were 
taking— that is, content-specific words. Haggard concluded 
that the process of collecting words can definitely enhance a 
college student's interest in expanding vocabulary, in both 
course content and general use. 
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We found only one study that experimentally investi- 
gated the value of asking college students to select the words 
they wish to learn. Whereas Haggard's study was descriptive, 
Gnewuch (1974) conducted a 12-week empirically based study 
with 407 college students. Those in the experimental groups 
(students enrolled in reading classes) skimmed their own read- 
ing to find words that they knew vaguely but felt they could not 
define adequately Then they were asked to write the words in 
the context in which they were found, make a guess at the 
meaning, and check that guess against a dictionary definition. 
Those in the control group (students enrolled in study skills 
classes) were given no special vocabulary instructions or guid- 
ance. The experimental subjects scored significantly higher- 
than the control subjects in vocabular)' growth on a standar - 
ized reading test. The questic^n remains as to whether the un- 
dents enrolled in study skills classes were equ:.! in ability to the 
students in the reading cLsses. Nevertheless, Gnewuch's find- 
ings are sufficiently intriguing to encourage the undertaking of 
other studies of this type. Future researcher^ should, however, 
collect data beyond sundardized test scores. For example, it 
would be informative to interview the students participating in 
such a project to discover their opinions about this approach 
and their strategies for learning unknown words. 



Content-Specific Vocabulary Development Studies 

While most earlier studies focused on how to increase 
general vocabulary, more recent studies have investigated gen- 
erative or teacher-directed strategies to te; h difficult but im- 
portant content area words. This latter orientation is similar 
to the knowledge hypothesis proposed by Anderson and 
Frcebody (1981); both stress that vocabulary should be taught 
within the context of learning new concepts so that new words 
can be related to one another and to prior knowledge. Thus, 
the source for words to be taught or studied is not teacher- 
made words lists but the difficult or unknown words that are 
critical for tne comprehension of specific content area reading 
assignments. 
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Some of the strategies reviously discussed— particularly 
those related to contextual analysis and affixes— could be used 
by students to understand key vocabulary encountered while 
learning from text. However, the strategies examined in this sec- 
tion differ from general vocabular)' development strategies be- 
cause the primary concern is for conceptual underst:mding. 

Research focusing on content-specific vocabular)' devel- 
opment in college students is limited. Results from studies dis- 
cussed in this section, however, strongly support the argument 
that college students can improve vocabulary while learning 
concepts from reading. 

Graphic organizers. Graphic organizers, often called 
structured overviews, graphically display key vocabular}' terms 
to show the interrelationship of new concepts and pre\'iously 
learned concepts. These organizers can be teacher- or student- 
generated and can be used before reading, following reading ')r 
at both times. 

The graphic organizer is based on Ausubefs (1963) the- 
ory of meaningful receptive learning. Auaubel proposed that 
new meanings in a content area can be more effectively ac- 
quired if they arc related to a p^^eviously learned background of 
relevant principles and concepts. Ausubel concluded that new 
learning could be facilitated if the lcarner\s existing knowledge 
of cognitive structure was well organized and stable. He pro- 
posed the advance organizer as oii^ strategy for organizing and 
strengthening the existing cognitive structure. Barron (1969), 
Earle (1970), and Estes, Mills, and Barron (1969) adapted 
Ausubers idea to the schematic presenLiti'jn of vocJ^jlaj y aorl 
labeled this strategythe structured ovenlew. 

Numerous studies have been conducted to measure the 
effects of graphic organizers on students' learning from text. 
Moore and Readence (1980) concluded from their metaanaljsis 
of 16 of these studies that only 2 percent of the variability in 
text learning could be explained by the use of graphic organic.- 
ers. The researchers noted, however, that the ad\antages of 
graphic organizers were stronger when they were used as a 
postreading activity and w hen vocabular) was included as the 
criterion variable. 
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Barron and Schwartz (1984j concluded from their re- 
view of research that the potential usefulness of graphic orga- 
nizers might have been camouflaged in past studies because 
teachers and researchers provided tht graphic organizers as 
readiness activities for the students. Barron and Schwartz sug- 
gested that it might be more beneficial to have students cOki- 
struct their own graphic organizers. Thus, the active 
involvement of the learner in the use of the graphic organizer 
(before or after reading) seems to be a critical factor to consider 
when examining the effects of graphic organizers on y^^abu- 
lary acquisition. Of the four studies reviewed below, two re- 
quired students to construct graphic organizers after reading, 
another provided students with graphic organizers before read- 
ing, and one required subjects to t^ite the effectiveness of differ- 
ent organizers. 

Bean, Wells, and Yopp (1981) asked two classes of fresh- 
men — one in a philosophy course and the other in a histor)' 
course— to rate the effectiveness of three models for using 
guide materials: (P instructor-prepared guides, (2) graphic post- 
organizers, and (3) /ocabularj' concept guides. Histor)' students 
rated all the guides highly, whereas philosophy students rated 
the graphic postotganizer as superior. Overall evaluation of stu- 
dent responses led the researchers to conclude that use of the 
graphic postorganizer with accompanying small group discus- 
sion among students "appears to increase deep semantic pro- 
cessing'* (p. 9). 

Carr (1985) examined the effectiveness of a vocabulary 
overview guide (a graphic organizer) and seif-monitoring in- 
struction on vocabular)' retention with 50 community college 
students. The students in the treatment group completed a vo- 
cabular}' organizer after reading a set of messages. Tl.jn they 
were asked to write self-generated clues on the organizer itself 
to relate the words to their own schemata. These students were 
also given a four-step procedure for studying the targeted 
words. Students in the control group read the same mc .*«ges 
the experimental group did, but they were required to defuie 
the target terms without using a vocabular) organizer. A \ocab- 



37 

Simpson ami Dtvyer 




ulary posttest and an unannounced delayed test (4 weeks later) 
were admipjstered to measure retention of the targeted words. 
The experimental group scored significantly higher on both the 
immediate and the delayed vocabulary tests. 

Carr's (1985) study used the graphic organizer on a post- 
learning basis and involved the students in the active comple- 
tion of their own organizers. This design was made even more 
potent by the inclusion of several critical treatment conditions: 

• Students were asked to record a personal reaction/ 
clue for each of the target words, thus ensuring per- 
sonal involvement. 

• Students were asked to sun^ey and skim for important 
unknown words and underline them before they 
read. 

• Students were given a four-step procedure to study 
the words. ^ 

• Students received training and guidance with eight 
practice passages before they participated in the study. 

Through careful and extensive utilization of the graphic 
organizer strategy, Carr has provided the strongest evidence of 
the efficacy of this approach. She concluded that »he graphic 
organizer can be an effective and efficient vocabulary learning 
strategy. Further research is needed to examine the effcutive- 
ncss of the graphic organizer approach using students' text- 
books and other forms of naturally occurring prose since Carr 
authored the passages * sed in »lie study Although the passages 
appear to be representative of text encountered by students in 
everyday reading, the fact that the material was artificially con- 
structed for research purposes remaitis a limitation, 

Barron and Schwartz (1984) examined the effects of 
graphic postorganizers on the leamii ig of vocabularj' relation- 
ships in a learning task undertaken with 64 graduate students. 
The experimental group was given four partially completed 
graphic postorganizers and asked to complete each organizer 
by inserting terms from an attached list of words. They were 
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ashigncd in pairs to complete the organization in 1 hour. At the 
end of the hour the instructor displayed the completed organiz- 
ers using an overhead projector. The control group was pre- 
sented with (he same word list, but this time the instructor 
defined and elabonited on the definitions of the words. One 
week after treatment all the subjects took a vocabulary relation- 
ship test consisting of 30 multiple choice items. . lie students 
who had completed the gniphic postorganizer performed sig- 
nificantl) better on the test than the control group. This finding 
is particularly impressive in light of the fact that the treatment 
condition lasted only 90 minutes. 

Barn)n and Schwartz (1984) referred to Ausubel's con- 
cept of learning sets to partially explain the strong positive ef- 
fects of the gniphic postorganizer treatment. The experimental 
subjects were involved in a meaningful learning set because 
the} were consciousi) and activelj attempting to relate and in- 
curponue less faniili:.r concepts into their cognitive structure, 
hi contrast, the control subjects were involved in a rote learning 
set \\ hea* information was processed on an arbitrarj- basis, thus 
increasing the nite of memorj loss since the new learning was 
not directly linked to existing knowledge. 

Pyros (1980) investigated the relationship between the 
use of advance gniphic organizers and the learning and reten- 
tion of vocabular) relationships from the content areas of psy- 
clioU)g> and economics. Subjects in the experimental group 
were given 1 hour of tniining on the purpose and function of 
the graphic organizer. During the stud) the experimental j;roup 
received both a verbal and a \isual presentation of an advance 
^ gniphic organizer from a unit in ps) cliolog). The control group 
jrcceiNcd a list of technical jernis with definitions that related to 
the same psjcliolog) unit. Both groups then read a 2,500- word 
selection from a college textb )k. Half of each group was tested 
with a \ocabular) relationship test immediately following the 
reading of the textbook passage. All subjects were given the 
same test 5 weeks later. This procedua* was repeated with a unit 
in economics. Anal) sis of the data re\ealcd no significant differ- 
ences between the groups on either the immediate or the dc- 
layed test in either content area. 
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The results of the Pyros (1980) study using advance or- 
ganizers contrast with the results of Barron and Schwartz 
(1980) and Carr(1985). However, an important difference must 
be noted. Barron and Schwartz and Carr actively involved stu- 
dents in developing organizers, whereas in the Pyros study the 
organizers were provided for the subjects. Apparently, the more 
actively involved students arc in the construction, manipula- 
tion, discussion, and independent study of the organizer, the 
morc'they seem to benefit. This is not surprising considering 
the similar general findings in vocabulary research. In future re- 
search, efforts should be made to taild on Carr*s promiciing 
findings and to study more comprehensively the issues exam- 
ined by Barron and Schwartz. Further, researchers are advised 
to undertake investigations to answer the following critical 
questions, at least in pan': 

1. Is the graphic postorganizer more advantageous to 
use in some content area tasks or reading situations 
than in others? 

2. Hov/ long does it uike to train college students to in- 
dependently construct, employ, and transfer a 
graphic postorganizer to their own learning situa- 
tions? 

3. How much control, regulation, and guidance ar' re- 
quired from an instructor to Jacilitate student devel- 
opment and ultimate practical application of a 
graphic organizer? 



NAIT. The Node Acquisition and Integration Technique, 
or NAIT (Diekhou, Brown, & Dansereau, 1982), is based primi/- 
ily on network models of long term memory struucurc (Collins 
& Loftus, 1975; Rumelhan, Lindsay, & Norman, 1972) and the 
depths of processing approach described by Craik ^nd Tulving 
(1975). The nait strategy was designed to help students system- 
atically select and define key concepts, consider examples and 
applications, and identify existing relationships among the con- 
cepts. 
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This strategy has four basic stages. In stage one the stu- 
dents are asked to identify key concepts or important terms 
they need to learn within a text. The second stage involves us- 
ing relationship-guided definitions to construct a semantic net- 
work around each of the selected key concepts. This is done by 
finding six different kinds of relationships linked to each tar- 
geted concept. The authors suggest using a definition work- 
sheet to facilitate this information-gathering process. In stage 
three, the elaboration stage, students are asked to .hink of ex- 
amples or potential applications of the key concept and to re- 
cord these examples on the definition worksheet. The final 
stage invoices making relationship-guided comparisons. In this 
step the students discover meaningful similarities and differ- 
ences among the different concepts being studied. 

Diekhoff, Brown, and Dansereau (1982) tested nait for 
effectiveness with 35 undergraduate students. The 16 students 
in the experimental group received 3 hours of nait training that 
utilized prose passages from biology physics, geography and 
geology Two days after the train- 3, both the experimental and 
the control group received two passages from an introductory 
psychology textbook to study for 60 minutes. The experimen- 
tal group was told to use nait in studying the passages, while 
students in the control group were told to use any of their own 
learning techniques. Following the study period, all passages 
and worksheets were collected from both groups. One week 
later both groups were given a 30-minute essay test on the pas- 
sages The test required the students to define and discuss five 
experimenter-selected key concepts in as much depth and detail 
as possible and to make comparisons among pairs of words se- 
lected by the researchers. The experimental subjects performed 
significantly better than the untrained control group on both 
measures, supporting the effectiveness of the nait approach. 
However, as the researchers pointed out, the testing format was 
obviously biased in favor of nait since the subjects were asked 
to recall the same information on the test that they had to recall 
in their nait training sessions. 
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Regardless of this research limitation, the NAIT strategy 
appears to be promising in that it actively involves the students 
in the selection of key vocabulary terms and then provide^ a 
systematic format to help them determine the definitions of 
these words, thus creating a stronger understanding than would 
ordinarily be gained without such intensive involvement. As 
the authors suggested, research should be undertaken to deter- 
mine the effectiveness of the approach where the test format 
differs from Nait's format. In addition, future studies should ex- 
amine the impact of nait with differing types of material to de- 
termine how effectively this strategy can be used in a variety of 
content areas. 

Effective Vocabulary Instruction 

Overall review and analysis of the literature suggest that 
relatively little is known about vocabulary instruction at the 
college level. More research must be undertaken to provide the 
means for college reading teachers to have at hand effective 
strategies for vocabulary instruction. Although the present 
research cannot conclusively recommend one vocabulary 
approach ^v^er another or even accurately descnbe a compre- 
hensive program of vocabulary instruction, there lough evi- 
dence to describe some characteristics of effective vocabulary 
instruction (Simpson, Nist, Sc Kirby, 1987). Five highly interre- 
lated characteristics will be examined in this section: (1) the use 
of mixed methods, (2) the active role of the learner, (3) the use 
of vocabulary in context, (4) capitalization on student interests, 
and (5) the incensity of instruction. 

Mixed Methods 

From reviews of research on vocabulary acquisition, 
Stahl (1983, 1985) suggested that a student who really knows a 
word has both definitional and contextual knowledge about 
that word. Stahl described definitional knowledge as knowl- 
edge of the relationships between a word and other known 
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words, such as those that appear in a dictionaiy definition or a 
network model of semantic memory (Collins & Loftus, 1975). 
Since most readers do not break words into their definitional 
parts dui. ^ comprehension, Stahl maintains that another type 
of information, contextual knowledge, is necessary to account 
for a reader's full knowledge of words. Contextual knowledge 
is the knowledge of a core concept, first acquired in a specific 
context, that becomes generalized or decontextualized through 
a number of exposures in different situations. 

When a method c. /ocabulary instruction involves the 
student in both the definitional and contextual information of 
the word, it can be termed a **mixed method." An important 
point to note is that a mixed method model does not necessar- 
Hy give equal emphasis to each strategy employed. Several stud- 
ies with college students (Anderson & Kulhavy, 1972; Carr, 
1985; Crist, 1981; Crist & Petrone, 1977) support the mixed 
method approach. 

Wliat does the research on mixed methods suggest for 
;he college reading teacher? Most important, instruction that 
emphasizes only memorization and pairing of labels to syno- 
nyms (e.g., arduous means difficult or hard) imparts only defi- 
nitional knowledge. Such knowledge is likely to have a 
negligible impact on a student's subsequent reading compre- 
hension and learning (Kameenui, Dixon, & Carnine, 1987). Stu- 
dents can easily memorize definitions of words from lists (they 
have done it all through the elementary and secondary grades), 
but they quickly forget those verbal associations. Thus, the col- 
lege reading teacher who uses materials or strategies that focus 
primarily on definitional knowledge needs to mcve beyond 
that point with additional strategies, including use of relevant 
teacher-made materials, to empha.Mze contextual under- 
standing. 

Active Role of the Learner 

Researchers who required subjects to be actively in- 
volved in their own vocabulary development (Anderson & 
Kulhavy, 1972; Bobrow & Bower, 1969; Carr, 1985; Dickhoff, 
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Brown, & Dansereau, 1982; Duffelmeyer, 1980; Pressley, Levin, 
& Miller, 1981, 1982) found that they performed significantly 
better than other subjects on measures designed to evaluate vo- 
cabulary knovJedge. From their reviews, Stahl (1983, 1985), 
Stahi and Fairbanks (1986), and Mezynski (1983) likewise con- 
cluded that active processing is critical for vocabulary acquisi- 
tion. Stahl (1985) labeled active involvement of the learner 
**generative processing." Generative processing engages stu- 
dents in activities such as restating formal definitions in their 
own words, creating semantic maps, studying definitional as- 
pects of a word, and writing sentences using t:irgetcd words. In 
contrast, passive asbociationai tasks related to vocabulary in- 
struction arc characterized by worksheet-type activities asking 
students to match words with definitions or by instructional 
methods such as asking students to repeat words and defini- 
tions aloud several times. 

It seems, then, that college reading teachers should use 
instructional materials and strategies that stimulate students to 
engage iri active thinking. Unfortunately, it appears that most 
commercial materials do not actively engage siudents in their 
own learning; rather, they tend to treat learners as passive re( ip- 
ients of knowledge. In a content analysis of 60 college-level vo- 
cabulary texts, Stahl, Brozo, and Simpson (1987) found that 
sentence completion and sentence fill-in exercises predomi- 
nated in 82 percent of the books, while matching exercises ap- 
peared in 70 percent of the texts. Further, these exercises are 
typically used in individualized or self-paced learning en\ iron- 
ments where little or no interaction occurs between student 
and teacher or between students. Research by St:ihl and Fair- 
banks (1986) suggests that group discussions arc more effecti\c 
than individualized assignments. 

The college reading professional, however, can make 
commercial materials more effective by nodifying or supple- 
menting them in several ways. For example, students could be 
invited to discuss workbook answers in small or large g^oup set 
tings. Such discussion might eng-.ge the students in gei.en*tive 
processing by encouraging them to justif) their answers An- 
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other approach would be to ask students to write their own 
sentences. Such activities would ensure that both definitional 
and contextual knowledge of a word is emphasized. The col- 
lege reading teacher could also experiment with the strategies 
previously discussed. These strategies actively involve students 
in deeper and more elaborate processing through such activities 
as imagining, finding examples, applying words to new con- 
texts, comparing and contrasting, and determining interrela- 
tionships among words. The keyword, nait, and graphic 
postorganizer strategies could be easily integrated vathin an ex- 
isting college reading program whether supplementary vocabu- 
lary workbook exercises were used or not. Lists of critical 
vocabulary terms, for use as target words, could be obtained 
from professors in various courses. Thus, students would have 
a practical reason for studying such word lists. 

Manzo's (1982) subjective approach to vocabulary (SAV), 
though not empirically tested with college students, holds 
promise for the college reading teacher since it requires stu- 
dents to make some personal images and active associations. 
The four-step SAV approach requires no special materials or 
preparation. In the first step the teacher explicitly presents a tar- 
get word with a definition and several contexts. In the second 
step the teacher invites active involvement by asking students 
what experiences, thoughts, or images they associate with the 
target word. To justify this step the teacher might mention that 
words arc easier to remember when personal images or experi- 
ences can be associated with them. If students offer no associa- 
tions, the icacher can start by offering his or her own 
associations with the target word. Once several personal associ- 
ations have been offered, the students move on to the third 
step, in which they write the word in vocabulary notebooks 
The notebook entry includes a dictionary-type definition along 
with a brief note about the student s personal associations, 
mental pictures, or experiences with the word. During the 
fourth step the students silently read a selection where the tar- 
get word occurs in relevant context. 

SAV, the keyword method, nait, and the graphic post- 
organizer invite the learner to engage in distinctive and elabo- 
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rate levels o*" processing by providing the opportunity to gain 
both definitional and contextual information about a word. 



Vocabulary in Context 

The main instructional approach in earlier vocabulary 
research involved giving students a list of words and requiring 
them to manipulate and memorize appropriate definitions. The 
long tenn benefits of such an approach on a student's expres- 
sive and receptive vocabulary, and on reading compreheii'iion, 
appear very limited. While there are numerous reasons for this 
lack of effectiveness, one important explanation needs to be 
emphasized: vocabulary should be taught from a unifying con- 
text Oenkins & Dixon, 1983; Mezynski, 1983). Words taught in 
the context of a subject area will be learned more effectively 
than words in isolation c from unrelated listb because context 
allows words to become integrated with previously acquired 
knowledge. As Mezynski (1983) points out, ''when a student 
encounters the word during reading, an organized schema can 
be activated, providing a large 'chunk' of information (as op- 
posed to a single definition) that can aid the construction of 
meaning" (p. 267). 

Thus, a college reading teacher needs to select or have 
the students select target words from textbooks, newspapers, 
magazines, or novels. For example, if students are reading a 
short selection from a speech textbook on words and their 
meaning, words s.'ch as arbitrary) connotation, denotation, 
or syntax could be intensely studied. Another alternative is to 
group target words into semantic categories (Beck, Perfetti, & 
McKeown, 1982). One such category could be adjectives that 
negatively describe a person's actions, lax, infantile, obseqiii- 
ous, narcissistic. Whatever approach is used to provide the 
context and organizing schema, college reading teachers need 
to remember that long term vocabulary learning occurs with- 
in realistic school-related or life-coping tasks, not within ar- 
tificially contrived word lists. This is true whether such 
words come from locally produced or commercially prepared 
materials. 
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Student Interest 

The idea that students can more efficiently and effec- 
tively learn concepts that interest them personally seems obvi- 
ous. However, the history of vocabulary instruction at the 
elementary, secondary, and postsecondary levels does not seem 
to acknowledge this obvious fact. The common routine of ask- 
ing students to look up words in a dictionary and write a sen- 
tence using the words is neither interesting nor beneficial to the 
typical college 'Student. 

One reason student inteiest may be lacking with current 
approaches or materials is that someone else (the teacher or the 
producer of commercial materials) has made an a priori deci- 
sion concerning the words students are to study and learn. 
When college students arc encouraged to select their own 
words, greater interest ib ensured. Consequently, they not only 
make significant gains on standardized measures (Gnewuch, 
1974) but also show more intrinsic interest in vocabulary* devel- 
opment (Haggard, 1984). 

College reading teachers therefore are advised to incor- 
porate strategics and approaches that encourage and re-vard stu- 
dents for learning new words of personal interest to them. 
Haggard's (1982) vocabulary self-collection strateg) (vss) is one 
approach to student-initiated vocabulary study that can be eas 
ily incorporated into virtually any existing program. During 
Haggard';> research on the conditions that expedite word learn- 
ing, she found that peer group usage and immediate usefulness 
were the most frequently cited reasons for learning new words 
during adolescence. 

vss capitalizes on these conditions by asking students to 
bring to class two words from their own environments (televi- 
sion, peers, reading) that thc> believe the whole class could 
benefit from learning. The teacher also selects two words. 
When the students enter the classroom, they immediately write 
the words on the chalkboard. Once the class officially begins, 
the students identif}- their words and tell what they mean (with 
a formal and/or informal definition), where they found the 
words, and why they feel the class should learn them. After all 




47 



Simpson andDwyer 



the words on the board (including the teacher's) have been ex- 
plained, the class narrows the list to a predetermined number of 
words. During the next phase, the students who introduced the 
words selected for study again define their words. The teacher 
facilitates the discussion by clarifying, redefining, and extend- 
ing student definitions. At this point, all the students record in 
their vocabulary journals the selected words and their defini- 
tions. By the end of the session, each student has a class list of 
words in addition to the two words he or she brought in. 

Haggard (1982) suggested several activities for reinforc- 
ing vocabulary from the class Hbt. Among the activities are writ- 
ing sentences, composing stories, and developing dialogues, all 
tasks emphasizing contextual information and generative pro- 
cessing. At the end of the week, all students are tested on the 
class list and on their own two words. 

Even though VSS has not been empirically researched, it 
has several virtues to recoir*nend it: it is sensible, it icquires lit- 
tle or no advance preparativ/n, and it can be easily modified to 
fit different environments (Simpson, N.^t, & Kirby, 1987). Strat- 
egies such as VSS that encourage and motivate students to be 
independent word learners should be an integral part of any 
comprehensive college reading program. 

Intensity of Instruction 

Research reviews by Jenkins and Dixon (1983), Mezynski 
(1983), and Stahl and Fairbanks (1986) have consistently con- 
cluded that for vocabulary instruction to be effective it should 
be intense. Intense instruction is characterized by the use of 
multiple examples, repetition, and review in differing contexts 
over a long period of time. An example of intense instruction is 
the frequently cited study with intermediate grade students by 
Beck, McCaslin, and McKeown (1980). In this study, 30 minutes 
a day were de\'Oted to vocabulary instruction over a 5-month 
period; a total of 104 words were taught, with each word re- 
ceiving between 16 and 22 different exposures. 

While brief practices can have some effect on an imme- 
diate vocabulary test, there is considerable memory loss over 
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time. However, researchers who have used a more intense ap- 
proach (Beck, McCaslin, & McKeown, 1980; Stahl, 1983) have 
noted little or no decline in the number of words learned even 
after delayed testing. Stahl and Fairbanks (1986) suggested that 
there is little decline in words learned through in.^nse iastruc- 
tion because multiple repetition leads to decontextualized 
knowledge of word meanings. Moreover, they concluded that 
students involved in intense vocabulary study tend to have 
fewer comprehension difficulties caused by slowness in lexical 
access. Nevertheless, by itself, intensity is not the critical char- 
acteristic of vocabulary instruction. Mere repetition of a word 
and its definition over time will not be beneficial unless the stu- 
dent is actively involved in processing. 

The implication of this research for the college reading 
professional is obvious. Fewer words should be taught, and 
more instruction time should be provided for meaningful rein- 
forcement activities and cumulative reviews in order to pro- 
mote the breadth of word knowledge necessary for long term 
retention and the ability to use target words successfully in in- 
dependent learning. 

These five characteristics of instruction can assist the 
college readmg professional in developing a systematic and 
conTiprehensive vocabular) program Materials and instructional 
approaches in such a program n- 'y emphasize the defini- 
tional and contextual information of a word but also involve 
students in the deeper or more elaborative processing levels. 
The words to be studied would come from what the students 
were reading or learning, not from commercial workbooks or 
lists. And, most important, such a comprehensive program 
would emphasize a wide variety of instructional and evaluative 
approaches since no one commercial pi'Ogram or strategy com- 
pletely addresses these research-based characteristics of effec- 
tive vocabular)' instruction. 

?uture Directions 

College reading professionals face three major chal- 
lenges. The first, and perhaps most important, requires that 
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thq^ objectively scrutinize their present programs with the fol- 
lowing questions in mind: 

1. Does the present vocabulary program offer a balance 
between more global strategies designed to encour- 
age general vocabulary development and more 
specific strategies designed to encourage student- 
initiated, often ^ontent-orientcd, vocabulary growth? 

2. Does the present program contain materials and em- 
ploy instructional strategies that require students to 
be involved in more elaborative levels of processing? 

3. Do the evaluation instruments used require students 
to demonstrate long term conceptual knowledge of 
the targeted words? 

4. Arc the instructional strategies and evaluation proce- 
dures used supported by research conducted with 
students rcprcsentative of those in the program? 

5. Does the prcsent program rcst on a sound theorctical 
base? 

A second major challenge for college reading profession- 
als is to provide ongoing feedback to the editors and writers of 
commercial materials concerning the relevance and qualify of 
their producib. CoU'^ge rcading teachers must not accept with- 
out question what publishers present. They need to examine 
materials in lij^ht of their own specific needs, keeping in mind 
what rcsearch has said about effective vocabulary instruction. 
As Stahl, Brozo, and Simpson (1987) discovercd in their content 
analysis of 55 vocabulary workbooks, the materials on the mar- 
ket today tend to be based on tradition rather than on research- 
supported principles. The critical link between researchers and 
publishers is the teacher; consequently, it is vital that college 
reading professionals offer their objective and constructive 
opinions on commercial materials. 

The final challenge for college reading professionals is to 
conduct with their own students action-oriented, applied, and 
empirical research. The process could begin with valuable de- 
scriptive studies, such as Haggard^s (1980, 1984), that ask stu- 
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dents to share their perceptions of how they learn new words 
and what strategies they use. A fruitful step is to conduct single- 
subject research, as Crist (1981) did, or to utilize a quasicxpcri- 
mental design in an actual classroom setting, like that of Beck, 
McCaslin, and McKeown (1980). Regardless of the app*- or 
design, more grassroots level research is needed with students 
enrolled in college reading programs. 

If the research is to be of value, it needs to focus on im- 
portant questions that arc unanswered. Although not all encom- 
passing, the following questions exemplify major issues that are 
still unresolved concerning college level vocabulary instruction. 

1. What long term effect does knowledge of affixes 
have on a student's subsequent vocabulary acquisi- 
tion? What type of training is necessary to ensure 
that students will transfer this knowledge to un- 
known words encountered in their reading? 

2. Can the key word method be readily implemented in 
actual classroom settings with the types of words col- 
lege students encounter in their assigned reading? 

3. Can research on the use of context clues with natu- 
rally occurring text demonstralo the effectiveness of 
this approach? 

4. What is the long range impact of having students se- 
lect their own words for vocabularj* study? 

5. Is the graphic postorganizer equally useful with all 
content area reading? What specific procedures will 
help train college students to independently con- 
struct these strategies and transfer them to their own 
learning? 

Researchers need to be sensitive to several condition^ to 
add lo the research base on vocabular)' instruction at the col- 
lege level. Further studies should include several types of expos- 
itory text and subjects with differing levels of reading 
competeuc}' rather than testing a strategy with only one type of 
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text and one type of reader Attempts should be mado to de- 
scribe the levels of processing required of the learner and, if 
comparing different strategies, to keep those processing re- 
quirements equivalent. Finally, with any research, whether 
quasiexperimentai or empirical, the college reading profes- 
sional should be careful to design evaluation instruments that 
not only reflect the breadth of knowledge desired about word 
meaning but also measure long term recall. Once these ques- 
tions have been adequately answered, the more critical issue of 
defining a comprehensive vocabulary program for college stu- 
dents can be addressed. 
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Although conducted primarily in elementary and 
middle school classrooms, Durkin's (1978-1979) re- 
search opened the floodgates for studies in the area of reading 
compi^hension. Durkin's findings, along with those of 
Armbruster and Gudbrandsen (1986) and Neilsen, Rennie, and 
Connell (1982), suggest that little direct comprehension instruc- 
tion occurs in the classroom. The overriding questions that 
emerge from this research are: Is comprehension being taught? 
Are instructors using teaching techniques that not only increase 
comptthension but also offer students strategies they will even- 
tually be able to use independently? More germane to this chap- 
ter is whether the teacher-directed comprehension strategies 
being used in college reading programs are helping students learn 
to deal with text. 
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Some college reading instructors insist that they are teach- 
ing comprehension by assigning repetitive skill-oriented work- 
book activities. Thi^^c activities (which usually consist of reading 
brief passages and then answering the multiple choice questions 
about them) provide no teacher direction except perhaps to tell 
students how many of these activities they are to carry out. Sim- 
ply because students are engaged in some type of compre- 
hension activity does not mean that the activir is either 
teacher-directed or strategic. 

To help determine the relationship between theory, re- 
search, and practice in this area, we examine each of three theo- 
retical bases that directly influence college level reading: 
metacognition, schema theory, and text structure. Metacognition 
generally is seen as the foundation on which comprehension is 
built. The instructor's role, therefore, is to create metacognitive 
awareness by teaching strategies that enable students to realize 
when their comprehension is breaking down. Schema theory is 
important to teacher-directed comprehension because of the role 
the organization of prior knowledge plays in understanding. Fi- 
nally, text structure (difficulty and organization) obviously affects 
comprehension. 

To link theorj' to research, we discuss studies that relate to 
each theoretical perspective. We tie in practice by discussing di- 
rect instruction and providing a generic model appropriate for 
use in college reading classrooms. Next, we address the specific 
teacher-directed comprehension strategies that are most appro- 
priate for college students, whenever possible presenting related 
research. (We define strategies here as methods or techniques in- 
structors choose to use with students on the basis of text, task, 
and student characteristics.) Finally, we draw conclusions from 
the research nnd offer suggestions for future lines of research. 

Theoretical Foundations 

Teacher directed comprehension strategies appear to be 
grounded in the three theoretical bases mentioned earlier, me- 
ucogr^.aon, schema theory, and text structure. While variations 
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exht within each theory, each contributes to our understanding 
of v^^xi; certain strategies work well with readers and others do 
not. 

Metacogpiition is important because unless students are 
aware of when their comprehension is breaking Jown and 
know what to do about it, teacher-directed strategies will fail. 
This is particularly true for at-risk populations since research 
indicates that poor readers tend to possess weak metacognitive 
abilities. Schema theory helps students organize, store, and re- 
trieve information. Text structure approaches help students 
comprehend what they read to the fullest. 

Mefacognition 

Althougl- some aspects of how we currently define me- 
tacognition are anything but new (Dewey, 1910; Thorndike, 
1917), the term was not directly related to reading comprehen- 
sion until the late 1970s. At that time, Flavell (1978) defined 
metacognition as '^knowledge that takes as its object or regu- 
lates any aspect of any cognitive endeavor ' (p. 8). More re- 
cently, Baker and Brown (1984), Brown, Armbruster, and Baker 
(1986), and Garner (1987a) have defined metacognition in 
more precise terms. These theorists delineate two (not necessar- 
ily independent) aspects of metacognition: knowledge about 
cognition and self-regulation of cognition. 

Knowledge about cognitiOxi concerns what readers 
know about both their cognitive resources and the regulation of 
those resources. Regulation includes the ability to detect errors 
or contradictions in text, knowledge of different strategies to 
use with different kinds of texts, and the ability to separate im- 
portant from unimportant information. According to Baker and 
Brown (1984), knowledge about cognition is both stable and 
siatable in that if readers know how to learn information, they 
can explain what they do when asked. 

The second key aspect of metacognition is readers' abil- 
ity to control or self-regulate their actions during reading. Self- 
regulation includes planning and monitoring, testing, revising, 
and evaluating the strategies employed when reading and learn- 
ing text (Baker & Brown, 1984). 
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In short, metacognition involves the regulation and con- 
trol of learning. It is a complex process that depends on several 
interrelated factors: the text, the required criterion task, the 
strategies readers know and use, and the readers' learning styles 
(Garner, 1987b). Because of its relevance, metacognition has be- 
come an integral part of models of learning and comprehension 
(Paris, Lipson, & Wixson, 1983; Weinstein & Mayer, 1986). 

Some might think that metacognitive theory relates pri- 
marily to student-centered comprehension strategies, but we 
behevethat it is also tightly tied to teacher-directed strategies. In 
fact, we view metacognition as the foundation of understand- 
ing. Students must be able to judge whether they understand 
the information presented by the instructor and also the man- 
ner in which it is presented. 

For those reading this article, the process of metacogni- 
tion may be automatic. Mature readers recognize when a com- 
prehension failure occurs and know what to do about it. Such 
individuals are metacognitively aware. In a nation of readers, 
however, they are in the minority. Research mdicates that there 
are major differences between the metacognitive abilities of 
poor readers and those of good readers (Schommer & Surber, 
1986). Nowhere is this discrepancy more clearly seen than in 
college leading programs. In an environment where 85 percent 
of all learning comes from independent reading (Baker, 1974), 
college students who are metacognitively unawaie probabl) 
will experience major academic problems. 

There also are differences between the metacognitive 
abilities of older readers and those of younger readers. Older 
students seem better able to regulate and control their under- 
standing than do younger children. Younger readers, even those 
identified as **good'' readers in relation to their peers, have dif- 
ficulty with monitoring and self-regulation. Markham s (1977) 
classic study indicated that when given directions for a card 
game, young children were unable to recognize that the direc- 
tions were incomplete and that it would be impossible to con- 
tinue with the game. Additional studies (Meyers & Paris, 1978) 
have indicated that even older grade school and h^'^h school 
students have similar problems with metacognitive ^ areness. 
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But there also appears to be something of a developmental 
trend: as children become older, their capacity to use meta- 
cognitive skills increases, and their reasons for not using these 
skills change. 

By the time students go lo college, they are expected to 
possess metacognitive skills. Professors have little sympathy for 
students who say they did poorly because they thought they 
understood the material but did not, studied the wrong infor- 
mation, or felt realy for a test when they really were not. Yet 
research indicates that among well-meaning college students, 
particularly those who are less skilled readers, failures in self- 
regulation are common (Schommer & Surber, 1986). 

Although considerable research has been conducted in 
the area of metacognition, much of it has focused on younger 
children. Studies carried out with either high school or college 
students are difficult to synthesize because of their smMl num- 
bers and diverse nature. What's more, the college-age subjects 
in these studies were enrolled in regular undergraduate courses 
(generally introductory psychology), and therefore did not nec- 
essarily typify students who would be enrolled in a college de- 
velopmental reading program. Thus, generalizability is 
5omething of a problem. Given this caveat, however, we can 
still draw some useful conclusions. 

Metacognitive studies involving older students and 
adults seem to break down into three main classifications: (1) 
those that compare tne metacognitive abilities of skilled readers 
with those of unskilled readers (baker, 1985; Gambrell & 
Heathington, 1981); (2) those that examine the effects of in- 
serted tex^ contradictions on the '^illusion of knowing" 
(Epstein, Glenberg, & Bradley, 1984; Glenberg, Wilkinson, & 
Epstein, 1982; Schommer & Surber, 1986); and (3) those that 
attempt to improve metacognitive abilities with som^e sort of 
strategic intervention (Larson et al., 1985; Pressley et al., 1987). 

In the comparison studies, differences surfaced in the 
metacognitive abilities of skilled and unskilled readers at all age 
levels. Poor readers generally lacked knowledge of comprehen- 
sion strategies, had misconceptions about the reading process, 
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and did not know what to do about comprehension failures 
(Gambrell & Heathington, 1981). In addition, poor readers 
used different standards by which to judge their understanding 
(Baker, 1985). 

The text contradiction studies found that when subjects 
were informed that a piece of text contained contradictions, 
they generally not only failed to detect the contradictions but 
also experienced a high **fals^ alarm" rate, frequently identify- 
ing noncontradictions as coraradictions (Epstein, Glenberg, & 
Bradley, 1984). In other contradiction studies, subjects experi- 
enced Sreater illusions of knowing (i.e., believing falsely that 
they understood what they read) with passages that researchers 
had rated as difficult, even though these passages required only 
shallow processing (Schommer & Surber, 1986). Results were 
consistent for both good and poor readers. 

Although research indicates that even college students 
lack needed mctacognitive skills (Baker, 1985), the results of the 
intervention studies suggest that college students can better 
monitor their level of text understanding and test preparedness 
by employing a variety of strategies. Pressley et al. (1987) found 
that when adjunct questions were inserted into reading pas- 
sages on which subjects were to be tested, the students' per- 
ceived readiness for examination improved. Elaborative devices 
such as cooperative learning pairs (Larson et al., 1985) were 
also found to improve metacognition. Any of these strategies 
should begin as teacher-directed activities and then be modified 
to become part of students' repertoire of comprehension 
activities. 

Schema Theory 

The second theoretical perspective that affects teacher- 
directed reading comprehenbion strategies— particularly at the 
college level— is schema theory. Schema theory relates to the 
effect of prior knowledge on a new learning situation. Like me- 
tacognition, the concept of schema theory is not new. It 
emerged in the early 1930s with Bartlett s (1932) somewhat 
ambiguous definition of schema, although it has been suggested 
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that Bartlett was at least partially influenced by Gestalt psychol- 
ogists (Anderson & Pearson, 1984). 

Recently, theorists have defined schema theory more 
specifically as an abstract framework that organizes knowledge 
in memor, by putting information into the correct **slots, 
each of which contains related parts (Anderson & Pearson, 
1984; Just & Carpenter, 1987; Wilson & Anderson, 1986). 
When new information enters memory, it not only must be 
compatible with one of the slots, but it must actually be entered 
into the proper slot before comprehension can occur Some re- 
searchers (Ausubel, 1963) believe that this knowledge is btruc- 
tured hierarchically, with the most abstract features of a 
concept at the top and the most concrete features at the 
bottom. 

According to schema theory, comprehension is an inter- 
active process between the text and the reader. Wilson and 
Anderson (1986) compare this interaction with putting together 
a jigsaw puzzle. If each piece of incoming information fits per- 
fectly into a slot, if each :>lot contains important information, 
and if the text is coherently interpreted (much like the pieces of 
u uzzle fitting snugly together), the text has been satisfactorily 
comprehended. The puzzle analogy breaks down after this, 
however, because even with a well-written text, the author ex* 
pects readers to make inferences, and therefore does not pro- 
vide information for every slot in a schema. 

The importance of schema theory as it relates to reading 
comprehension can be seen in the six functions a schema per- 
forms. These functions affect both the learning and the remem- 
bering of textual information (Anderson. 1978, Anderson & 
Pichert, 1978; Anderson, Spiro, & Anderson, 1978): 

1. A schema provides ideation ' scaffolding. Schemata 
provide a framework for oi^^anizing incoming infor- 
mation and retrieving stored information. Text infor- 
mation fits into slots within each schema. For 
example, if readers. have been exposed to World War 
II in high school, they already possess an initial 
framework into which new information can be in- 
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corporated when they read about the war again in 
college. 

2. A schema permits selective attention. Schemata help 
readers select the important information from the 
text. Good readers attend more to important infor- 
mation and to material that is unfamiliar to them. 

3. A schema permits inference making. As noted earlier, 
no text is completely explicit; a reader will always 
need to make inferences, no matter how well written 
the text is. Schemata permit such inferences by ena- 
bling readers to fill in the p:»ps with preexisting 
knowledge. The publisher of a college history text 
containing a chapter on World War II, for example, 
may assume that students already possess some infor- 
mation about the war and thus not include that 
material. 

4. A schema allows orderly memnry searches. Since 
schemata have slots for certam pieces of information, 
the reader can be guided to the kinds of information 
that need to be retrieved. If readers can follow che 
schema the author used to structure the text, later 
they will be able to retrieve information learned dur- 
ing text reading. Remembering the key headings, for 
example, allows students to limit a memory search to 
information that pertains to the desired heading 
rather than searching all information. 

5. A schema facilitates editing and summarizing. This 
function also relates to readers' abilities to determine 
key ideas. Since a schema allows readers to distin- 
guish important from imimportant information, it 
also facilitates the formulation of graphic organizers 
or questions containing important information. For 
example, after reading the World War II chapter, stu- 
dents should be able to state or make a map of the 
key ideas presented. 

6. A schema permits inferential reconstruction. Readers 
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often have gaps in their memory; a schema helps 
them generate hypotheses about the missing informa- 
tion. Remembering a key battle, for example, might 
help a learner remember the general who fought in 
the battle. 

While a considerable amount of research supports the 
various theoretical aspects of schema theory (Bartlett, 1932; 
Just & Carpenter, 1980; Sunford & Garrod, 1981), rcctnc studies 
also ha"e focused on the practical classroom applications and 
implications of schemata and prior knowledge. These studies 
can be grouped into three main categories: (1) manipulation 
studies, in which subjects call up schemata based on manipu- 
lated texts or purposes; (2) cross-cultural studies, which exam- 
ine how students' cultural familiarity with a subject affects the 
way they learn and interpret information about that subject; 
and (3) expert-novice studies, which present a topic and then 
compare the learning strategies of subjects who have little 
knowledge about that topic with the strategies of knowledge- 
able subjects. 

Currently schema activation is being incorporated as a 
regular part of teacher-diu cted reading instniction in the public 
schools Oust & Carpenter 1987), but comprehension instruc- 
tion in college reading programs often fails to address the im- 
portance of schema theory and prior knowledge in text 
comprehension. Thus, schema activation often does not occur 

Manipulation studies. Much of tht research on schema 
theory has focused on manipulation studies, often employing 
^ntrived passages and situations to induce a particular sce- 
nario. For insta nce, Pichert and Anderson (1977) told subjects 
to read an ambiguous passage about a house from the viewpoint 
of either a prospective burglar or a pi 7>ective homebuyer 
Subjects tended to remember mere of th mformation that was 
pertinent to their assigned group, those in the homebuyer 
group were more likely to remember that the house had a leaky 
roof, whereas those in the burglar group were more likely to 
remember that the house had a color TV and a valuable coin 



ERIC 



.65 



Nist and Mealcy 



collection. Additional research using these same scenarios ''An- 
derson & Pichert, 1978; Anderson, Pichert, & Shircy, 1983) has 
extended the initial research by having subjects switch perspec- 
tives after the first reading. Subjects in these studies were often 
able to recall previously unrecalled information after the per- 
spective shift. These findings also held true for u 2-week de- 
layed recall period. As a result of these studies, Anderson, 
Pichert, and Shirey concluded that schema influenced not only 
the activation but also the retrieval of knowledge. 

Numcvous other studies have found similar results 
(Anderson et al., 1977; Henk & Helfeldt, 1985; Sjogren & 
Timpson, 1979). However, a more recent study by Henk and 
Helfeldt (1987) produced different findings. In this study, three 
different groups of students— music majors, physical education 
majors, and elementar>' education majors— read an ambiguous 
text that could have been interpreted as being about either play- 
ing cards of playing music. The students' perspectives (as indi- 
cated by their majors) had little effect on their reading of the 
text. 

The key difference between this study and previous 
studies seems to be the methodology used, this difference may 
account for the variance in results. Heiik and Helfeldt (1985) 
presented the sentences one at a time rather than in paragraph 
form, as had been the case in past studies. The subjects noted 
when there was a change in what they thought the passage was 
about. Virtually aL subjects changed their ideas, and "'0 percent 
of the subjects indicated an awareness of alternative explana- 
tions of the paragraph. According to the authors, these data sug- 
gest that acommodation and assimilation maj play larger roles 
in interpreting ambiguous text than was once believed. The 
results also indicate that even if the "wrong" schema is acti- 
vated, additional information could correct misconceptions 
While the Henk and Helfeldt research has jet to be replicated, it 
offers a new and interesting perspective to the schema literature 
that certainly deserves further exploration. 

The overall results of the manipulation research indicate 
that it is important for college readens to activate the proper 
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schema and that instructors should teach students how to iden- 
tify and deal with ambiguous text. While it probably is safe to 
say t** at no text will be as ambiguous as the contrived passages 
used in manv of the studies, it is still important for college x^ad 
ing instructors to teach students u^ys to identify and handle 
ambiguous information. 

Cross<ultural sttidies. Although cross-culural studies 
number the fewest, their results have considerable implications 
for college reading instructors. Two studies— one examining 
two totally different cultures, and the second Cvcamiiiing cul- 
tural differences between blacks and whites within the United 
States— offer strong support not only for the notion of schema 
theor) but also for the idea that it is important for instructors to 
help students activate the proper schema. 

In many w;ays, cross-ciiltunil studies are similar to the 
manipulation studies of Bransford and McCarrell (19"'4) and 
Anderson et al. (1977). These two studies compared individuals 
majoring in or expected to be familiar . ith particular areas of 
an ambiguous topic. Depending on their backgrounds, the 
groups interpreted the passages differently. Similarly, cross- 
Lultunil studies ha\e compared students from different cultures 
or subcultures in terms of i>:ieir ability to read, comprehend, 
and interpret culturally related passages. Steffensen, Joag-dev, 
and Anderson (1979) had natives of India and the United States 
read two passages, one dealing with an American wedding and 
the other with an Indian wedding. The results of the study pro- 
\ ided strong evidcuLC for the role that schemata plaj in reading 
comprehension. Subject'^ spent more rending time on the cul- 
turally unfamiliar passage *uid made Hiorc distortions when re- 
calling that passage. In addition, subjects recalled more 
cultural!) important propositions from the Lulturall) familiar 
passage. 

In a study exploring how blacL. \nd whites interpreted 
the idea of "sounding"— an inner cit) term— Labov (19"'2) and 
Reynolds et al. (1982) again found that culture played a key ro^c 
•n schema formation. Both groups read a passage that described 
Sounding as a fun, one-up-manship, give-and-take form (»f plaj 
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with words. While whitt ^enagcrs tended to view ihe passage 
AS violent and confrontational, blacks understood the passage 
for what it was. These ix:sulis,have strong implications fci se- 
lecting the kinds of mate 'als that should be used in college 
reading claisrooms. Obviously, college reading instructors must 
be sensiti\^ to the responses of cultural g^ups w hen selecting 
material to read. 

Expert-novice studies. Simply stated, expert-novice 
studicb examine the learning diffeix:nceb between hubjectb who 
are knowledgeable about a speclrlc tonic and these who lack 
knowledge at ut that topic but are equal in terms of intelli- 
gence, verba, ability, and reading ability. Spilich ct al. (1979) 
and Chiesi, Spilich, and Voss (1979; used subjects' knowledge 
of baseball to determine the mle schema plays in learning new 
information and in designating what is important, Spilich et al. 
(1979) found thai when subjects listened to a passage about 
baseball, those who knew a lot about the sport were better able 
to remember and s)nthesi/.e important information than were 
those with little knowledge, who tended to include unimport^ 
ant information in their recalls. 

These studies indicate tha^ learning new mformation fs 
easier if one already has a considerable amount of know! * v 
about the topic (Chiesi, Spilich, & Voss. 1979). This facility 
sumabl) results from the preexistence of know ledge structures 
or slots, which can be expanded and organized to ins^lude the 
new information. Mean and Voss (1985) corroborated these 
findings in addition to noting developmental trends in the com 
plexity and levels of schema. 

In college reading programs, which cater to students 
with widely varjing degrees of background knowledge, the im- 
plications of the expertnoN ice research are obvious. Instructors 
mu^t be sensitive to the fact that some students will learn and 
understand the material more readil), depending on the amount 
of prior knowledge they possess. Instructors also mast devise 
teaching methods that incorporate and build upon students' 
backgrounds. 
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Text Structure 

The third factor that influences teacher-directed college 
level comprehension instruction is text structure. Until recently, 
researchers and practitioners alike have relied on readability 
formulas to determine text difficulty. Most formulas, however, 
fail to provide an accurate picture of text difficulty because they 
measure cnly vocabulary^ frequency, word length, and sentence 
length. Hence , readability formulas have long been criticized 
foi being primarily concerned with surface factors and failing 
to consider the text's conceptual level or structure (Meyer & 
Rice, 1984). However, some researchers have included text 
structure in their theories (Kintsch & van Dijk, 1978; Kintsch & 
Vipond, 1979; Klare, 1984), and others have examined text dif- 
ficulty solely from the perspective of text structure (Anderson 
& Armbruster, 1986; Meyer, 1977, 1979, 1983, 1985). These 
studies examine text through three types of structure, micro- 
propositions, macropropositions, and top-level structure 
(Meyer, 1981 ; van Dijk, 1979). 

Microproposittons. Micropropositions, or microstruc- 
tures, are the lowest level of text structure, dealing with linguis- 
tic analysis at the sentence level. Research at this level is often 
associated with connectives such as "because," "although," or 
"rather" (Marshall & Clock, 1978; Walmsley, 1977), or with co- 
hesive ties (Hallida) & Hasan, 1976). These links help text flow 
or hang together. 

Instruction in micropropositions generally takes the 
form of asking students to combine information from one sen- 
tence w ith that of another. When researchers examined this ac- 
tivit), they found that it had a positive effect on reading 
comprehension (Combs, 1975, Strav.', 1979). Other niicrostruc- 
turc research has found that the greater the number of concepts 
presented in brief, eas> reading paragraphs, the longer it tak^s 
subjects to read the paragraphs and the less the) recall (Kintsch 
et al., 1975). The same patterns emerged with more difficult 
and unfamiliar passages, as well as when subjects listened ij 
passages rather than reading them. 
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Macropropositions. Rather than focusing on the linguis- 
tic or syntactic level, macropropositions, or macroscructures 
(van Dijk, 1977), tend to focus on the logical relationships 
among the ideas presented in the text. Several classifications of 
macrostructures exist (Fredericksen, 1975; Grimes, 1975; 
Halliday & Hasan, 1976; Meyer, 1975). We will focus on Meyer's 
system because it is representative and because it allows practi- 
cal application. Meyer examines five groups of logical relation- 
ships: 

1. antecedent/consequent (cause/effect) relationships, 
showing a causal relationship between ideas; 

2. response relationships, including problem/solution, 
question/answer, and remark/reply; 

3. comparison relationships, dealing with likenesses 
and differences among ideas; 

4. collection relationships, showing that ideas are 
linked by one or more common factors; and 

5 description relationships, giving information by pre- 
senting attributes or explanations about a topic. 

Meyer's system is valuable for classroom use since stu- 
dents need to be taught only a limited number of classifications, 
which they can then apply to their own texts. While van Dijk s 
(1977) system may be more closely tied with schema theory in 
that it asks students to call up "frames'* or "slots" to help them 
organize reading, it fails to provide a set of relationships that 
can be taught and then applied. Much of the more recent ma- 
cropropobition research has focused on Meyer s work, in fact, a 
considerable amount of the research in this area has been con- 
ducted by Meyer and her colleagues. These studies have fo- 
cused on determining which type of structure tends to produce 
the highest level of immediate and delayed recall. In general, 
this research has indicated that subjects can recall more infor- 
mation from the compare/contrast structure (Meyer & Freedle, 
1984; Richgels et al., 1987), but that even with this structure, 
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recall is higher on the delayed measure i^Meyer & Freedle, 
1984). 



Other findings appear to indicate that better students use 
text structure to a greater extent than do poorer students, but 
that even good readers are inconsistent in their use of structure. 
Often, good readers use the same structure as that of the target 
passage to organize their free recall, while poor readers do not 
(Meyer, Brandt, & Bluth, 198C). Without training, however, 
even college-age students tend not to be aware of the differ- 
ences among text structures (Heibert, Englert, & Brennen, 



Top-level structure. The final factor in both of these text 
structure systems is that of top-level structure, or the overall or- 
ganizing principles of a text. Most of the work to date in this 
area has been done with narrative materials, most often in the 
form of story grammars (Mandler& Johnson, 1977, Rumelhart, 
1975; Stein & Glenn, 19"^9). Like macrostructures, sto./ gram- 
mars are closely related to schemata. According to the s'^.orj 
grammar theory, every- stor} has six elements that together t> p> 
ify story structure, setting, initiating event, internal response, 
attempt, consequence, and reaction (Stem & Gienn). Hence, 
when students know these elements, their stor) schema is im- 
mediately activated, making understanding both easier .nd 
better. 

Other research has focused primarily on training sub- 
jects to identify the top-level structure used in various disci- 
plines. Brooks a.id Dansereau (1983) found that subjects could 
be taught to use a structural schema to improve recall of science 
texts. However, the) also found that even with training, subjects 
often failed to employ the target text's organ\,.ition in their free 
recalls. 

In another series of experiments, Barnett (1984) found 
similar results. His subjects were assigned to one of six condi- 
tions in which they read a passage structur^^ in cither a journal- 
istic or a scientific style. In some conditions the passage 
organization was described and in others it was not, the de- 
scription was given either before or after subjects read the pas- 
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sage. Barnett found that while subjects who received the 
organizational patterns before reading perfonned statistically 
better than those who received the descriptions afterwards or 
not at all, the text structure had no major effect on recall. How- 
ever, Barnett's study seems flawed for two reasons. First, al- 
though Barnett called this a training study, subjects actually 
received no direct training. Second, all subjects performed 
poorly on the dependent measure — the highest score vj^ only 
58 percent. Hence, even those who receivea the organizational 
patterns before reading "failed" the critenon measure. 

Textual coherence, Anderson and Armbruster (1986) 
take a somewhat different— and perhaps for college reading in- 
structors, a more practical — approach to examining text strac- 
ture. They examine text in terms of local and global coherence, 
working under the logical assumption that the more conerent 
the text, the more likely it is that readers will construct a clear 
understanding. 

The first element of Anderson and Armbruster's (1986) 
system is local coherence. According to Tiernej and Mosenthal 
^1982), local coherence functions like linguistic mortar to hold 
ideas together in text. It is similar to microstructures and micro- 
propositions in that it is achieved through the correct use of 
pronoun referents, substitutions, connectives, or conjunctions. 
If texts are to cohere locally, the relationships among ideas 
should be explicitly stated and connecti\ es should not be mi:>s 
ing or merely implied. In addition, if appropriate, e\ents should 
be arranged in causal or temporal sequence. Finally, referents 
should be clear. 

The second clement, global coherence, is similar to van 
Dijk's (1977) macrosf ructures. When texts cohere globally, they 
are structured so that the ideas are arrai;ged logically and con- 
nected in such a way that they arc easily understood. Content 
also play^s a part, since the signifit ice and accuracy of what 
the author writes affect global coherence. For example, the au- 
thor may pain a colorful picture for the reader but fail to offer 
pertinent infoimation about the key concepts presented. Accu- 
racy may also present a problem— particularly since instructors 
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and students alike often take the primed word as law and there- 
fore fail to detect inaccuracies in text. Thus, Anderson and 
Armbruster (1986) assert that in looking at coherence, content 
as well as structure must be examined. In all, texts that are.giob- 
ally coherent should be predictable; chapters should be ar- 
rant jd logically and fit into an overall plan or structure. 

Text coherence is particularly important to developmen- 
tal college readers for three reasons. First, the students enrolled 
in college reading programs have reading deficiencies and need 
all the assistance they can get from text. Second, because a co- 
hesive text can be read more quickly and is more easily under- 
stood, it enables developmental students to infer more when 
they read. Third, since developmental students often enter col- 
lege with insufficient background knowledge, coherent texts 
help because they provide students with information in a logi- 
cal and predictable order without requiring quantum leaps in 
understanding. 

Direct Instruction 

A discussion of teacher-directed co^,Tiprehension strate- 
gies would certainly be incomplete without a review of the im- 
portance and elements of direct in^., action. The relevance of 
direct instruction emerged from the teacher effectiveness re- 
search that received attention in the late 1970s and early 1980s 
(Berliner, 1981; Berliner & Rosenshine, 1977; Rosenshine, 
1979). The emergence in the early 1970s of cognitive psychol- 
ogy, which emphasized the reading process rather than the 
product, also has contributed to recognition of the important 
role direct instruction plays in the reading process. As a result, 
reading educators have realized t'lat when students get 5 out of 
10 items correct it does not necessarily mean that they know 
only 50 percent of the information. It means that instructors 
should consider the kinds of items students are missing and 
why they are missing them. These ideas are slowly beginning to 
penetrate college reading programs. 

More recently, the importance of direct instruction in 
learning transfer has been addressed. If we as college reading 



educators expect students to map key text concepts on their 
own or to generate questions during reading, ' e need to teach 
them how to carry out these tasks. For example, Hare and 
Borchardt (1984) found that subjects who received direct in- 
struction employed summarization rales more effectively and 
improved the quality of their summaries. Garner (198"'a) reiter- 
ated the importance of learning strategic rules through direct 
instruction. Still others (Nist, 1987a; Weinstein & Mayer, 1986) 
suggest that direct instruction is necessary if we expect students 
to transfer the strategies learned in a college reading class to reg- 
ular college courses. 

We believe that the two most valuable types of direct in- 
struction models for college readirg instructors to use are the 
self-control training model (Brown, Campione, & Day, 1981) 
and the teacher-to-learner model (Nist & Kirby, Iv j6) The self- 
control model relies heavily on student monit ing as a way of 
encouraging transfer, while the teacher-to-I.arner model fo- 
cuses on gradually weaning students from reliance on instructor 
guidance and assistance. 

The Brown, Campione, and Day model was derived 
from Jenkins's (1979) tetraht Iral model, !t includes four over- 
lapping and interacting components, the characteristics of the 
learner, the criterion tasks that must be carried out, the nacure 
of the materials, and the learning activities employed. Student 
monitoring enters into each of these four components; based 
on the text, tne task, and their own personal characteristics, st'i- 
dents mast be able to select the proper learning activity and 
monitor their understanding during learning. While the authors 
stress that instructors must teach students how to extract and 
learn important information from text, they fail to suggest how 
to do so. In addition, the instruction di ^ed in the article fo- 
cuses more on training subjects in expern... research studies 
than it does on training subjects in traditional classroom 
settings. 

The Nist and Kirby (1986) model, which has be' i used 
successfully in college reading and study strategy classes, moves 
students away from teacher dependence and toward carrying 
out strategies on their own. The model also includes a mcta- 
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cognitive component to help students get a feel for their level 
of understanding once teacher guidance is limited or with- 
drawn. Tiansfer results from direct instruction based on the 
concept of observational learning through modeling (Bandura, 
1969) and thinking aloud. Following the Nist and Kirby model, 
instructors guide Icatners through a complex series of interre- 
lated steps: 

1. Focus attention. The instructor must initiate an activ- 
ity or make a statement as a way of preparing stu- 
dents to learn. 

2. Give a general overview. The instructor should in- 
form students what they are going to do. This step 
helps students understand where they will begin and 
end and puts them in the proper learning mindset. 

3. Introduce any new terms. The instructor needs to 
point out new terms, particularly content-specific or 
frequently occurring words with which the students 
may not be familiar. 

4. Go through the procedure step by step. During this 
phase, the instructor gives students a **cookbook" 
procedure to follow. The message here is watch anu 
listen. At this point, students assume thr^ the instruc- 
tor's way is the most efficient and effective. Unfortu- 
nately, many instructors begin and end their 
instruction with this step. 

5. Model the process. Next, the instructor must show 
the **how'* of learning. Instructors think aloud, 
showing St dents how a mature learner thinks 
through an idea or solves a problem. They also show 
students metacognitive devices by indicating not 
only when and where they are having problems un- 
derstanding text but also what they do about their 
comprehension failures. 

6. Guide practice. Students now repeat the instructor's 
strategy using new situations or problems. Insiruc- 
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tors should be available to help students and to guide 
them in modifying ine/fective processes and thinl^ 
ing. This activity is best undertaken at the end of the 
class during which the instructor presented and mod- 
eled the strategy. 

7. Encourage independent practice. Students should 
also practice this strategy ou their own outside the 
classroom. This practice will allow teachers to give 
students additional process and product feedback re- 
garding their use of the strategy. 

8. Redemomtrate if necessary. Rarely will students ac- 
quire the correct behaviors the first time through. In- 
structors need to remodel processes, while helping 
students learn how to better monitor their own 
learning. 



As these steps progress, the responsibility for leaming 
moves from the teacher to the student. While the steps cannot 
be neatly categorized, the model as a whole is a three-phase 
process: in the first stage, the responsibility falls totally on the 
teacher; in the second stage, the responsibility is shared as 
teacher and student work together; and in the third stage, stu- 
dents become responsible for their ow.i learning. It is not until 
this third stage that transfer occurs. 

Every college reading instructor strives to get students to 
the point of transfer, but this is a difficult goal to accomplish. 
The next seciion discusses strategies that can be used to get stu- 
dents on the road to taking charge of their own learning and 
eventually to being able to transfer information to new leaming 
situations. 



Strategies 

St.rategies for teaching comprehension abound in the lit- 
erature on reading and studying. Dut while many of these strate- 
gies are popular and accepted, few are grounded in a solid 
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research base. Fewer still have been examined using at-risk stu- 
dents enrolled in college reading courses. Where possible, we 
will cite research that has been used with high school and col- 
lege students as subjects; in the absence of such research, other 
studies will be discussed. 

Most of the vast number of strategies recommended can 
be placed into one of three classifications: organizers, question- 
ing techniques, and guides. Some of these strategies cai. be used 
before, during, or after reading, and some are appropriate at all 
three t'im<;s. We have noted within the discussion of each strat- 
egy when it may optimally be used. 

Organizers 

The purpose of organizers is to build and activate stu- 
dents' background knowledge, cue awareness of the quality 
-md quantity of that knowledge, and focus atrention before 
leading. Many kinds of organizers exist, and their effectiveness 
differs acrow situations. College reading instructors must select 
the appropriate organizer by carefully considering the difficulty 
ot the text and, even more important, the ability and prior 
knowledge of the learners. 

Advance organizers. Tbr advance organizer, developed 
jy Ausubel (1963, 1968), is probably the best known preread- 
iag strategy It consists of prefatory material that is written at a 
higher level of abstraction than the target text. Tightly tied to 
present-day schema theory, its purpose is to prepare students 
for i^d'ngby drawing on their prior knowledge and providing 
ideational, or intellectual, scaffolding to help build comprehen- 
sion of new information. Ideational scaffolding is the basic cog- 
nitive structure on which pieces of new, related information 
may be hung (Ausubel, 1968). 

Two problems are apparent with, the research on ad- 
vance organizers. First, although advance organizers have been 
the subject of countless studies, research reviews (Barnes & 
Clawson, 1975; Kardey & Davies, 1976; Lawton & Wanska, 
1977; Mayer, 1979), and the more recent metaanalysei (Luiten, 
Ames, & Ack'erson, I960; Moorc & Readence, 1980), conclusive 
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evidence of their effectiveness has not bten found. To com- 
pound the problem, Ausubel (1968) has given no specifics 
about the actual development and writing of advance organiz- 
ers. Thus rei^erxchers who test these organizers* effectiveness 
may each be devising very different materials for Uoe in their 
studies. The materials may not be true advance ori,^nizers, 
therefore, results of both individual studies and advance orga- 
nizer research ?s a whole may be questionable. 

The research suggests that students exposed to advance 
organizers tend to improve in problem solving and in recalling 
conceptual information from scier'^e text, but that they per- 
form less well when attempting to ^call details and technical 
information (Mayer, 1983). It is important to note that students 
may need to paraphrase or otherwise encode organizer material 
in addi.con to attending to its present:uion in order to reap an) 
benefit from it (Dinnel & Glover, 1985). 

Another finding is that whiL advance organizers may be 
more effective with older students, they ma) not work well for 
poorer readers (Luiten, Ames, & Acker on, 1980). This is a seri- 
ous point for considv tion by college reading instructors, since 
only Smith and Hesse (1969) report benefits for poor readers. 
However, Vacca and Vacca s (1986) guidelines for the use of ad- 
vance organizers may increase the usefulness of these tools for 
poor readers. According to these researchers, instructors 
should use advance organizers onl) with difficult material, and 
should supplement them with analogies and questions. In addi- 
tion, the organizers should consist of the text s superordinate 
ideas and include examples with which students are familiar. 
(See Weil & Jo)'ce, 19*^8, for advance organizer de\dopment 
guidelines.) 

Although Ausubel (1968) maintains that advance orga- 
nizers should be written at a higher level of abstraction, general- 
ity, and inclusiveness than the text to be presented, Anderson 
(1935) suggests that more concrete, familiar language nu) bet- 
ter facilitate students' learning. This recommen lation ma) be 
especially pertinent when dealing with college reading 
students. 
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Graphic organizers. Graphic organizers (Barron, 1969), 
also called structured overviews, are hierarchically arranged 
tree diagrams of a text's key terms and concepts. In a revealing 
metaanalysis, Moore and Readence (1984) found that graphic 
organizers were more effective than the advance organizers 
from which they derive (Dean-Guilford, 1981; Kellehcr, 1982; 
Moore & Readence, 1980). Graphic organizers have an advan- 
tage over advance organizers in that their construction is de- 
fined clearly and concretely, which makes them easier for 
teachers and students to design. 

Interestingly, the effectiveness of graphic organizers 
tends to be more pronounced when students devise them as a 
postreading strategy, although graphic organizers were origin 
nally meant to be used as teacher-directed prereaditig activity 
(Moore & Readence, 1984). Indeed, there is some evidence 
from this metaanalysis to suggest that construction of graphic 
organizers enhances the teacher's feeling of preparation. Moore 
and Readence also ^osit that student involvement ma) be the 
reason for graphic organizers' reported effectiveness. This idea 
supports Dinnel and Glover's (1985) finding thai student en- 
coding of graphic organizers may be a key factor in their effec- 
tiveness. 

In addition to helping instructors :each new content vo- 
cabulary before reading (Moore & Readence, 1984), graphic or- 
ganizers can be useful in indicating text structure by outlining 
cause/effect, problem/solution, compare/contrast, chronology, 
and other patterns. (Foi guidance in developing text structure 
graphic organizers, see Readence, Bean, & Baldwin, 1985.) 
Hence, graphic organizers are grounded not only in schema 
theory but alsc in text structure theory. Students should be 
made aware of the text structure (Bartlett, 19"'8), or organiza- 
tional patterns, in order to benefit from both the graphic orga- 
nizer ak d the material to be learned. Visual representations of 
key concepts often enable students to see these organizational 
patterns. Thus, the graphic organizer should make the text's 
structure explicit. Graphic organizers that go bejond the simple 
presentation of terms and develop the relationships between 
concepts will be more effective. 
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When deciding whether to use this strategy with college 
students in developmental or remedial reading programs, the 
instructor should take note that students may need strong ver- 
bal skills for the graphic organizer to be effective, especially as a 
prereading strategy (Tierney & Cunningham, 1984). Develop- 
ment and use of well-honed metacognitive skills may also be in 
order. Therefore, the graphic organizer may be more effective 
with at-ri*>k populations if instructors emphasize the vocabularj 
of the content area being studied and help students construct 
graphic organizers after reading. This endeavor will be difficult 
for college reading students without a great deal of direct in- 
struction, practice, and teacher feedback, followed by gradual 
tapering of instruction o\cr the course of a quarter or semester. 
As noted in the discussion of direct instruction models, this ta- 
pering of teacher guidance and e\'cntual assumption of student 
responsibility are difficult to achieve. Instructors can alleviate 
this problem, as well as make the strategy more relevant to stu- 
dents, if they use gmphic organizers with content area mate- 
rial — especially since the students will need to grapple with 
lengthy texts, become familiar with various organizational pat- 
terns, and detect key concepts and their interrelationships. 

A positive feature of the graphic organizer, from the 
teacher'*^ point of view, is that its form can be varied according 
to its desired purpose. In addition, training in this strategy may 
indeed facilitate transfer to new text (Dansereau, Holley, & 
Collins, 1980). Mapping (Armbruster & Anderson, 1980^ can be 
considered a variation of the graphic organizer, but again its ef- 
fectiveness is optimal during the postreading, elaboration stage. 

Previews, Another organizer used as a prereading strat- 
egy is the oral or story preview (Graves & Cooke, 1980). The 
preview is more than just a few introductory statements, it is a 
somewhat length) d'^scription that prov ides considerable infor- 
mation about an upcoming expository or narrative text. The in- 
structor attempts to link students* prior knowledge with the 
new information that will be encountered, thus, previews arc 
rclatedto schema theory. Instead of simpl) assigning a selection 
(e.g., "read to page 130 for Wednesday'*), the instructor builds 
anticipation and interest in the content, directs students' atten- 
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tion, and reminds them, through discussion, of what they al- 
scady know about the topic at hand. In addition, the preview 
allows instructors to **plant" purpose-setting questions and 
thoughts in order to give students direction when they read. If 
the instructor carries it out properly, this process can also lead 
to increased metacognitive awareness. (See Vacri & Vacca, 
1986, for a thorough description of preview construction.) 

The effectiveness of previews, especially with difficult 
materials, is well substantiated for use with students at all levels 
(Alvarez, 1983; Graves & Cooke, 1980; Graves, Cooke, 
LaBerge, 1983; Graves & Prenn, 1984; Hood, 1981; Risko & 
Alvarez, 1986). This research indicates that previews help stu- 
dents understaiid, remember, and make inferences about narra- 
tive or expositor)' content. 

Analogies, An analog) is "an expositional method of 
comparing oets of information that are similar enough in essen- 
tial respects to permit transposition of attributes across sets, 
usually from familiar to unfamiliar information" (Tierney & 
Cunningham, 1984, p 6l3). Analogies are often suggested as a 
prereading organi/mg strateg), but research findings on their ef- 
fectiveness are far from conclusive. Extant studies show that ii 
instructors fail to make explicit the comparijon between a fa- 
miliar and un unfamiliar concept, the effectiveness of the anal- 
ogy decreases considembl) (Perfetti. Bransford, & Frank., 
1983). 

Glynn et al. (1990) suggest the following model for 
teaching analogies. (1) introduce target, (2) cue retrieval of ana- 
log, (3) identify relevant feature's of target and analog, (4) map 
similarities, (5) draw conclusions about target, and (6) indicate 
where- analog) /eaks down. Note the similarities between this 
model and the dire-ct instruction model. It isparticularl) impor- 
tant to realize that misunderstanding ma) occur if the instructor 
neglects the last step, telling students in what wa) the analog 
and the target are* dissimilar (comparisons are never identical). 
Teachers should make a special point of leading students to ex- 
amme all comparisons between the analog anc target in order 
to find where the analogy b'-^aks down (Glynn et aL). 
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Summary of organizer findinvs. While not conclusive, 
the research on organizers appears to cautiously support their 
use. Advance orgauirers, the most controversial in terms of sup- 
port, arc probably beneficial in providing ideational scaffolding 
long as they are written >n a concrete way and presented be- 
fore students read difficult material. Graphic organizers m.iy 
best be used as a postreading activity, with emphasis on the pre- 
viously taught content vocabulary. This strategy may also be 
used with the aim of teaching students how to construct their 
own organizers, but success will depend on the amount of 
training, practice, and feedback students receive over sevenil 
weeks. In addition, graphic organizers can help studer in- 
crease their knowledge of text structure. Research supports the 
use of previews before reading expositor) or narnitive material 
and suggests that these organizers ar^ffecti\e with students of 
ages. Th<uise of analogies is certainly not unequivocalU sup- 
ported, but tliey may be a good way to link a faniliar concept 
with an unfamiliar ^ne, as' long as the instructor indic;Ktes 
where the analogy fails to correspond. 

Overall, organizers arc certainly u to schema theory, 
and some also rclate to text structurc theorj. While all organis- 
ers improve metacognitive awarcness in some waj, those con 
structed by students contribute more to building strong 
monitoring abilities. 

Questioning 

Qjestioning has many purposes, from prompting the re 
tncval of prior knowledge and focusing attention to checking 
literal, inferential, and applied comprehension uf information 
and predicting possible test items Questionmg also jnipro\es 
comprehension (Hamilton, 1985i Klauer, 1984, Tierncy & 
Cunningham, 1984), and it holds an important place in the col* 
lege reading classroom. Research in this area h;ib much to offer 
instructors. It can help them understand how different tjpes of 
questions and their placement affect students* le\cl >f compre- 
hension as well as how to e\ aluate questioning btrategicrh for ubc 
with college reading students. (For a comprehcnsi\e re\iew of 
questioning, see Graesser & Black, 1985.) 
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Types of questions. The questioning frameworks s 
gested by Herber (1978), who looks solely at questions thei 
selves, and Pearson and Johnson (1978), whose model als 
takes into account answers to questions, offer instructors guid-, 
ance m fomiwlating inquiries that tap different kvcf|-o|TEit>;^ 
dents' understandinc of text. Teachers can become of 
these k\els and use them with students to acti\ ate pric^p^^l; 
edge, focus attention, and evaluate comprehension, ^^^h^ 

Texttially explicit questions (Pearson & JohnsQi|j^^8) 
are based on the text, and their wording is sinilar or ev^hJjden- 
tical to that of the text. Since students retrieve lacts (^tf^ctly 
from the text, these questions require only an un Jerstanaing of 
\v hut the author explicith states. Texttially implicit questions 
demand the interwea\ ing of text information and students' 
prior aowledge. Readers must :nake reaoonable inferences 
from the facts at hand and fix)m what they alread) know about 
a particular topic Both Meyers (1975) and van Dijk's (197^") 
systems of text anal) sis note the comprehension problems 
caused by text that requires excessive ^nferencing. This problem 
m^y be eased b) using a third type of question, scripttuilly /m- 
/>//c/r questions, which go beyond tc- tual information by ask- 
ing readers to gi\ e plausible answers b*ised on their experiences 
as they relate to the text. 

Placement of questions. The placement of questions — 
w hether they are asked before, during, or after reading— can 
grcatl) affect students' comprehension. Such effects are evi- 
denced in the tlieoret,' .al schi »na studies discussed earlier as 
well as in more practical studies. 

Prereading questions activate schema and cue important 
information (i.e., intentional learning), so students tend to learn 
that material better, but perhaps at the expense of information 
the) need to extract from text on their own (Anderson & 
Biddle, 1975). Prereading questions also facilitate comprehen- 
sion of more difficult material (Levin & Pressley, 1981). There- 
fore, if instructors want students to focus only on very specific 
parts of .he text or if they want to help students understand 
difficult text, prereading questions are an option. However, col- 
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lege reading students may be better served by other prereading 
aids, such as organizers. The temp«xition for at-risk students to 
focus solely on the information requested in prereading ques- 
tions (which are usually text-exp Mcit) may be too greac, and a 
fuller understanding of the content text may be sacrificed. 

Postreading questions are more effective if incidental 
comprehension is the objective because these questions help 
students learn information of both greater and lesser impor- 
tance (Anderson & Biddle, 1975). Alvermann (1987) suggests 
that this effect occurs because students probably anticipate tests 
covering the majority of the material rather than a few specific 
pieces of information. A major problem with many of the stud- 
ies in this area, howwer, is that the questions on the test to mea- 
sure intentional learning are the same as those asked in the 
postreading questioning session. Thib situation does not occur 
in actual classroom settings. In the few studies examining per- 
formance on tests using different questions, the erfeci of 
postreading questions wa^ quite small (Anderson & Biddle, 
1975). The value of questioning at this stage, therefore, may de- 
pend on the nature and level of the questions as well as on stu- 
dents' i^aracipation in the questioning process and the qualit} 
of their responses. 

Taking into consideration the effect of the levels of ques- 
tions also is important. Many studies suggest that asking h jr 
level textually and scriptuall) implicit questions prompts better 
performance than asking factual, textually explicit questions 
(Denner, 1982; Rickards, 1976; Yost, Avila, & Vexler, 1977). But 
while higher level questions are important, we arc not ;)Uggest- 
ing that factual questions should be omitted. In a college read- 
ing course, it is frequentl) necessary to check comprehension 
of content are? material by asking textuall) explicit as well as 
textually and scriptually implicit questions. 

Questions supplied during readf ^, or inserted ques- 
tions, tend to focus students' attention and improve their per- 
formance cn the targeted information (Reynolds & Anderson, 
1984). In a delayed test, however, Duchastel and Nungester 
(1984) found ao statistical differences in performance between 
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students who answered postreading questions and those who 
answered inserted questions, although both treatments were 
more effective than the control condition. 

Teacher-provided questions appear to enhance recall of 
main ideas and deiails more than student-generated questions 
(Andre & Anderson, 1979; Denner & Rickards, 1987). Unless 
students are trained to generate different levels of questions, 
their tendency i:> to devise literal questions that focus on less 
important details, if the instructor chooses not to teach stu- 
dents how to generate questions, providing conceptual ques 
tions is an adequate alternative. 

ReQuesL ReQuest (Manzo, 1969), or reciprocal question- 
ing, places much of the responsibility for generating questions 
on the students. First, both the students and the instructor si- 
lently read the same segment of text; next, students ask the in- 
structor a number of questions about the target information, 
and then the instructor a?ks questions of the class. If many of 
the students' questions are textually explicit, the teacher can 
model higher level questioning. Finally, the teacher asks the stu- 
dents to predict furcher information or occurrences. After the 
entire selection is read, discussion centers around the accurac) 
of the predictions. 

This strategy differs fr(.m traditional teacher-centered 
questioning in that it prompts students to become more active 
and involved with the text. It is a'- j an alternative to the ques- 
tioning stage of sy3R-type activities. ReQuest will work well 
with college reading students as long as the instructor is careful 
about choosing the kind and amount of text read. Text structure 
comes into play here: it the text is difficult, smaller sections, 
even individual sentences, should be selected for the ReQuest 
procedure, with easier text, longer passages may be used While 
it is important not to overuse a strategy and tliUo possibly 
dampctt motivation, students need repeated exposure to the Re- 
Quest procedure to improve their questioning behavior and in- 
crease their autonomy with text. 

Qtiestion-cinswer relationship (QAR). qar (Raphael, 
1982, 1984) builds on Pearson and Johnson's (19T'8) three-tier 
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model of questioning and takes into account both the level of 
the question and tb'* location of the answer. The QAR ccrategy 
alerts students to the differences between higher and lowex 
level question types, called **Right There" (textually explicit), 
"Think and Search" (textually implicit), r.id ''On Your Own" 
(scriptuaily implicit). The instructor i> jvides passages and 
questions as well as answers from each Qar catcgor}'. Discus- 
sion focuses on the questions and on the location of their an- 
wers. Students may work in groups ox alone to determine both 
answers and Qar categories. Eveniualiy, students generate ques- 
tions, either for their own use or for class discussion, making 
sure that each Qar category is tapped. 

QAR requires a substantial amount of direct instruction 
before student questioning improves. Also, depending on stu- 
dents' attitudes, it may be advisable to substitute Berber's 
(1978) framework of literal, inferential, and applied for 
Raphael s terms. Many college reading students are sensitive to 
being in a strategies course; using ter- . they perceive as child- 
ish or high schooHsx. may undermine the benefits of the strat- 
egy Also, the insrructor needs t . guard against the tendency to 
focus too mucn on le\ els of questions and not enough on actual 
content. 

Directed readi?ig-thinking activity (drta). The drta 
(Stauffer, 1969), can be modified for use in college reading or 
content area classes. Presetting purposes for reading and elicit- 
ing student prediction and speculation about the material are 
the ke) s to this strategv. First, students survey the title, subhead- 
ings, and graphs, and predict orally or in w riting what the mate- 
rial will be about. Once they have read a segment of the text, 
the instructor asks them to refine their predictions, clarify in- 
formation, and define unfamiliar vocabulary More speculation 
ensues, after which students read the next segment and discuss 
or refine the predictions already made. This cycle is co.itinued 
ur A the text is finished. The instructor should ask highei level 
questions to stimulate thinking and speculation. Stud ents' opin- 
ions mjst be reinforced with information from the text or from 
experience. 
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The DRTA probably is most effective with at-risk students 
who have great difficulty learning from text. Short reading seg- 
ments .md discussion will help them verbalize main ideas and 
supporting details, give them opportunities to learn specialized 
content vocabular>', and improve their understanding of impor- 
tant signal words such as honever, therefore, and nevertheless. 
It might be advisable to use this strategy in the beginning of the 
quarter or semester tor the nrst few pieces of assigned text, 
gradually fading out the stop-Start aspect of reading (Hansen, 
1981) and moving into strategies that require more autono- 
mous learning behavior. 

Su.nmary of questioning finduigs. Questioning posi- 
tively influences comprehension, but in unexpected ways. In- 
structors need to be aware of the effects ^f different levels of 
questions, the placement of questions, and different teacher-di- 
rected questioning strategies. Questioning is influenced by both 
text structure and schema theor>\ and it helps students grow 
metacogaitively b> calling attention to areas of text with which 
they may be experiencing difficulty. 

In order to ensure that they are not simply asking stu- 
dents to regurgitate facts from text, teachers can rely on guid- 
;»nce irom comprehension franieworks, such as Herber s (1978) 
ind Pearson and Johnson's (1978), to tap higher levels of stu- 
dent understanding. Asking more textually and scriptually im 
plicit questions will enrich comprehension and prompt 
students to engage the text more actively, using their own expe- 
rience to connect with new information. 

Placcinent of questions can seriously influencv the qual- 
It) UP'' quantity of comprehen^on. Pre.*eading questions cue 
important information that probably will be learned well, but at 
the expense of other main ideas and detaik. Postreading ques- 
tions, on the other hand, may be more effective for broader un- 
derstanding of text, however, the quality and level of questions 
need to be assessed, as does the degree of student participation 
in the questioning process. Inserted questions are as effective as 
postreading questions and may serve to focus student attention 
during reading. Often, pioviding question > is a more effective 
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strategy than haying students generate their own questions un- 
less tbey are carefally trained to emphasize irain ideas and tap 
into different levels of comprehension. 

Instructors must select from a v^Jety of questioning 
strategies on the basis of students' ability and prior knowledge, 
whether training is feasible, and the desired performance. With 
the student-centered ReQuest strategy, teachers model desired 
questioning behavior without explicitly stating the differences 
among literal, inferential, and applied questions. Ilie purpose 
of QAR, on the other hand, is to make students more av/are of 
the different types of questions and sources of answers; there- 
fore, if provoking that awareness is the instructor s goal, qar is 
an excellent strategy. The key to drta is prediction and reading 
short segments of text for preset purposes. This goal gives stu 
dents specified reading goals and iv,iids to engender a great deal 
of discussion based on experience and inference, drta is espe- 
cially suitable for use with poor readers. 

Guides 

Guides are used while the material is read to provide stu- 
dents with questions directed at different levels of comprehen- 
sion, as well as with warnings, signals, and other directions. 
The purpose of guides is to lead students through difficult text 
by questioning and distinguishing unporiant from less impor- 
tant information. Some guides may not be as beneficial as other 
teacher- directed strategies for college reading students, since 
the hand-holding features inuerent in guides might give stu- 
dents mixed signab regarding what independent learning is all 
about. 

Anticipation guides. Herber (1978) devised this type of 
study guide lo aid students in predicting text concepts. The an- 
ticipation guide consists of a list of statements to which stu- 
dents respond prior to reading a text. The statements may or 
may not support facts or the author's point of view. The stu- 
dents mark :be statements ^rue/false or agiee/disagree. Their an- 
swers reflec* their level of background knowledge, thus, these 
guides draw heavily from schem.a theory. (See Readence, Bean, 
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& Baldwin, 1985, for suggestions on constructing anticipation 
guides.) 

After discussing each statement, students read vO see if 
their prediction*^ and prioi knowledge are accurate or in accord 
with the author s point of view. Students may refine or ch*;nge 
their prior knowledge. In addition, instructors can get a good 
idea of the depth and breadth of students' prior knowledge and 
take any necessary compensatory measures. Instructors may 
also ask students to return to the original statements after read- 
ing and use them as a reaction guide and a basis for discussion 
tx» see how or if their p^^rceptions and knowledge have changed 
as a result of reading. 

This strategy appears to be effective with college reading 
students, who perceive it as a type of advance organizer and a 
chance to bring prior knowledge to bear on content. When 
theic prior knowledge is incorrect, the reaction aspect of the 
guide lets them see for themselves that they were wrong and 
have learned as a result of reading. 

Marginal glosses. The marginal gloss (Richgt's & Mateja, 
1984) operates as an in-text study guide with the eventual pur 
pose of showing students how to annotate text. The instructor 
provides noutions of interesting points in the text, prompting 
the student to extract specific main ideas, lists, and examples. 
In this sense, the marginal gloss can help students see the top- 
level structure of text. This strategy may be pait'cularly useful if 
the instructor plans on teaching students .lOW to mark text. Ini- 
tially providing cne glosses for :,tudents is similar to modeling 
an annotation marking system (INist, 1987b). It is important to 
remember, however, that the goal is independent learning. 
Thus, phasing out the marginal gloss technique and training stu- 
dents to write their ow n glosses or annotations is the prefcrr^^d 
route . 

Study guides. Although listing literal-level questions is 
usually the norm with study gu.'des, Readence, Bean, and 
Baldwin (1985) recommend that instructors develop guides 
with Herber s (1978) or Pearson and Johnson s (19T'8) question- 
ing framework in mind. Vacca and \'acca (1986) recommend 
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the similar three-level guide, v/hich uses the anticipation- 
reaction format, using statements reflecting the three levels of 
comprehension rather than questions. Students respond to the 
statements before, during, or after reading. 

Selective Reading Guide-O-Rama. The Selective Read- 
ing Guide-O-Rama (Cunningham & Shablak, 1975) points out 
only die most important information in the text so that students 
do not need to read an entire selection. Obviuusl), the Guide- 
0-Rama should be used only for certain purposes, such as read- 
ing for main ideas and perhaps skimmi.ig. If it is used 
frequently, students may get the idea that reading entire texis is 
not often necessary. 

Pattern guides. These guides elucidate the patterns of 
text structure ,*such as compare/contract, cause/effect, and chro- 
nology As noted earlier, when text patterns are made explicit to 
students, comprehension increases (Bartlett, 1978; Meyer, 
Brandt, & Bluth, 1980). Vacca and Vacca (1986) suggest that 
pattern guides be designed in such a way that students must re- 
spond to text structure by examining the relationships between 
concepts in the material. For instance, for a text with a predom- 
inantly cause/effect structure, the instructor can list either the 
cause or the effect and have the students suppl) the missing ele- 
ment of the pair; for a chronology patt rn, the instructor can 
list certain events from the text and ask students to supply the 
missing occurrences. 

Summary of guide findings. While very little res< arch 
focuses on the effectiveness of guides, what does exist indicates 
a modest ositive effect on comprehension. However, college 
reading iu. jctors should proceed with care when choosing 
which to use. Keeping in mind the goal of helpmg students be- 
come independent learners, instructors need to judge how 
much assistance students require with different texts at different 
times during the quarter or semester. In add? ion, they must 
take into account the desired levels of comprehension and the 
types of text structure used in order to choose the prereading, 
during, and postreading strategies that offer the best opportuni 
ties for successful learning. 
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Diff-^^nt types of guides serve different purposes. Antic- 
ipation guides are generally useful as both prereading and post- 
reading organizers since they encompass prediction, use of 
prior knowledge, and a check of comprehension. The marginal 
gloss is probably best used in teaching text marking systems, es- 
pecially annotation. Study guides, such as the three-level guide, 
should be approached with considerable caution since they 
may not benefit college reading students who need to be shown 
strategies for achieving academic autonomy. Finally, pattern 
guides may be an appropriate and effective way of getting stu- 
dents to grapple with the link between text structure and com- 
prehension. 

Conclusions and Recommendations 

For Instruction 

The varying populations, methods, and quality of stud- 
ies can *eave well-meaning instructors feeling overwheLned 
and possibly confused about the extant research and its lack of 
conclusive findings. While it is difficult to recommend the use 
of certain strategies when research fails to solidly support their 
effectiveness, we have attempted to determine which strategics 
are more solidly supported than others, which strategies may be 
effective with devclof mental students, and where trouble spots 
may emerge. 

Of the many kinds of organizers available, graphic orga- 
nizers, previews, and (if judiciously st!c*cted and used) analogies 
are best supported. Graphic organizers in particular are quick 
and easy to construct and very helpful, althof^h they are even 
more effective as a student-centered activity. The use of oral 
and story previews is advocated, but these organizers require 
considerable preparation on t' ,e instructor's part. Analogies can 
be very effective, but only when the analog and the target con- 
cept correspond closely and when any dissimilarities arc 
pointed out by the instructor. Advance organizers that are de- 
vised as Ausubel (1963, 1968) recommend^^ may not be effec- 
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tive with developmental students. Instead, instructors should 
use advance organizers to introduce new concepts and materi- 
als through concrete ideas and familiar language. 

Questioning is an excellent instructional tactic as long as 
teachers are aware of the different levels of que tions, the ef- 
fects of question placement, and the various recommended 
strategies. Questioning frameworks can guide teachers in their 
attempts to enhance student comprehension. Asking more tex- 
tually and scriptually implicit questions w ill prompt students to 
draw on previous experience and know ledge to connect w ith 
new concepts. Prereading, inserted, and postreading questions 
have different effects, which instructors should be aware of in 
order to direct students' attention to the material targeted for 
learning. Guides have yet to be the object of much research, but 
the few .elevant studies point to some benefits for students 
Guides may be useful for at-risk populations if they are used 
only for the first two or three assigned texts, and only with dif- 
ficult t^xts. Ultimately, guides should be replaced with strong 
prereading organizers and questioning strategies th* t gniduall) 
pass the responsibility fur learning to the students, as a group 
and individually. 

For Research 

Our review of the theory and research related to teacher- 
directed comprehension strategies at the ' ollege le\'el points to 
several conclusions and recommendations.' Most evident is the 
lack of research conducted with at-risk students at the college 
level. Although most of the strategies discussed have been ex- 
amined in studies using college students, the subjects were gen- 
erally enrolled in introductory ps)cholos) or education classes, 
not in developmental reading classes. This problem calls into 
question the generalizability of the results to at-risk college stu- 
dents and casts doubt on the suggestions made in nun.erous 
pedagogical articles directed at college reading teachers. 

Many of these sti .egies are not grounded in solid re- 
search bases, yet practitioners appear to view them as such So 
great is the problem that, for some strategies, we could find no 
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empirically based studies that demonstrated effectiveness or in- 
effectiveness. Therefore, we recommend that future research 
begin to focus on developmental populations in order to deter- 
mine which teacher-directed comprehension strategies lead to 
the greatest increase in learning and to the creation of autono- 
mous learners. 

A second observation concerns the methodology em- 
ployed in the empirical studies using college students as sub- 
jects. Although the strategies in question are classified as 
teacher-directed, few empirical studies involved any training 
component. As a result, such investigations fail to reveal what 
could happen with instructor intervention and suggest only 
what happens when subjects arc told to use a certain strategy or 
technique. Another methodology concern is that most of the 
studies were short in duration, some collecting data for only 15 
miiiutes at a time. We found these data collecuv^n procedures 
very disturbing, particularly since in order to gain any statistical 
results when testing strategies the treatment must be powerful 
and training must occur over an extended period of time. We 
recommend that futuie empirical studies incorporate a training 
component that occurs over a reasonable amount of time. 

A third positive point is that, for the most j)art, the rc- 
search that has been conducted on teacher-direct :d compre- 
hension strategies appears to be solidly grounded in theorj. AU 
of the strategies, particularly questioning, improve metacogni- 
tive avs'areness and thus abo improve comprehension. Both 
guides and organizers are firmly grounded in schem; theorj. In 
particular, advance organizers help students call up prior 
knowled e and i)ro\ ue for ideational scaffolding as a means of 
accommodating ne^^ information Guides that are constructed 
to help students berter understand' how texts are organized also 
aid in comprehension. 

Fourth, seriously lacking; in tiie literature are studies indi- 
cating that teacher-directed strategies eventually lead to tr*\nsfer 
Lnless college students can move beyond teacher dependence 
and apply strategies on their own, thej will ha\'e a difficult time 
being academicallj successful in college. Studies must be de- 
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vised that indicate alternative methods instructors can employ 
to move students toward becoming independent learners with 
strong comprehending abilities. For example, anticipation 
guides push students to call up prior knowledge and perhaps to 
begin thinking differently about a topic. As instructors, we 
know that once students leave the confines of college reading 
classes they are not going to sit down and construct their own 
guides; we hope they will begin to think about what they are 
going to read before beginning an assignment. Studies that 
would indicate the value of teacher-directed comprehension 
strategies as a springboard to transfer arc needed. 
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Textbook Study 
Strategies 
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Many students come to reading and learning centers 
at the college level to seek help in reading or 
studying their textbooks. Within these centers, the focus of read- 
ing instruction may range from basic literacy to critical reading of 
graduate-level textbooks. Instruction in studying, on the other 
hand, is usually direaed toward strategies for learning from text- 
books: that is, learning how to learn when reading. The first r;*^o 
chapters of this book review the teaching of reading at the col- 
lege level. This chapter discusses te^xhing students the strategies 
for studying a textbook. While this distinction is subtle, it will 
become clear as we proceed. 

At the outset, let us posit our definition of textbook 
studying. Tbctbook studying is a strategic approach to reading in 
which students adjust their comprehending behavior before. 
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during, and after reading much as they do in general reading, but 
with the purpose of satisfying a specific task that comes from 
either an internal or an external need. Thus it differs from general 
reading in tnat comprehension is strategically directed toward a 
specific task, such as gaining knowledge for a future career or 
passing a course test. This definition evolved from our review of 
the literature on reading comprehension and studying and is con- 
sistent with other definitions of studying (Anderson & 
Amibruster, 1984; McKeachie, 1988, Rohwer, 1984; Thomas & 
Rohwer, 1986; Wade & Reynolds, 1989). 

Reviews on studying textbooks from the past two decades 
conclude that most study strategies are successful given certain 
conditions. First, a given study strategy's success will vary with 
the student's prior knowledge, reading ability, and motivation 
(Anderson, 1978; Breuker, 1984; Cook & Mayer, 1983; 
Dansereau, 1980, 1985; Levin, 1986; Rigney, 1978; Simpson, 
1984; Weinstein & Mayer, 1985; Weinstein & Underwood, 1985; 
Wittrock, Marks, & Doctorow, 1975). Second, a given study 
strategy wiU vary in effectiveness dc-pending on the difficulty, or- 
ganization, and content of the material (Baker & Brown, 1984; 
F.euker, 1984; Jonassen, 1985; McConkie, 1977). Third, a given 
study strategy must be taught to be effective (Dansereau et al., 
1974; Goetz, 1984; Orlando, 1978; Rigney, 1978; Simpson, 
1984; Weinstein & Mayer, 1985). Fourth, a given study strategy 
can be effective if it is chosen to fit a particular type of criterion 
task (Anderson, 1980; Baker & Brown, 1984; Cook & Mayer, 
1983; Gibbs Morgan, & Taylor, 1982; Levin, 1986; Wade & Rey- 
nolds, 1989; Weinstein & Mayer, 198*^). Recently, a spate of re- 
views have suggested that a combination of these four variables 
best explains the effectiveness of a particular study strategy (An- 
derson & Armbruster, 1984; Campione & Armbruster, 1985; 
McKeachie, 1988; Paris, 1988; Rohwer, 1984; Schumacher, 
1987; Ifessmer & Jonassen, 1988; Thomas & Rohwer, 1986; Wit- 
trock, 1988). 

Our analysis of the literature leads us to favor the view of 
these more recent reviews. Specifically, we believe that the inter- 
action among these four variables (^student, material, orienting 
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task, and criterion task) is crucial for understanding the effective- 
ness of study strategies. The question, therefore, is not whether 
study strategies are successful, but rather where, when, and un- 
der what conditions they are successful. In this review we ex- 
plore these questions, as well as determine what empirical 
research still needs to be completed and what should be taught 
to our students when they select a strategy for textbook study- 
ing. 

To explore these questions, we first review how our un- 
derstanding of cognition has evolved over the past century into 
our current ideas about hov.'' learning takes place and how study 
str? jgies can foster learning from textbooks. Then, we review 
the empirical literature on five study strategies for textbooks — 
underlining, notetaking, outlining, mapping, and SQ3R (Survey, 
Question, Read, Recite, Review)— in light of the four variables 
identified above and the interactions among them. Next, w? sug- 
gest avenues of future research on these study strategies. Finally, 
we draw conclusions and implications for teaching these study 
strategies to a college-level population. 

An Evolving Theoretical Foundation 

Current concepts of studying derive from the knowl- 
edge about cognition that has been garnered over the past cen- 
tury. This transmutation of J'.nowledge has resulted in the 
sequential evolution of three perspectives about the studying 
process: product, process, and intent. The first perspective de- 
fined studying as a product enhanced by overt manipulations 
after reading a textbook. The second perspective stressed the 
need to improve the product by controlling the overt process of 
studying during and after reading. A third perspective has re- 
cently emerged that emphasizes teaching students to select a 
study strategy on the basis of the resources they bring to the 
text, the material they are reading, and the purpose for which 
they are studying. This third perspective stresses the intent of 
studying before, during, and after reading. 
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Figure 1 

jdroadening Perspectives of Studying Theory 




Note that these perspectives arc not mutually exclusive, 
nor do they represent distinct alternative choices. They simply 
differ in the degree of comprehensiveness with which they em- 
brace our collective knowledge about cognition. They should 
be seen as one embedded within another, like concentric cir- 
cles, each encompassing and going beyond the perspective 
within (Figure 1). 

Understanding the evolution of these three perspectives, 
and the major empirical findings giving rise to this evolution, is 
an important first step in understanding textbook study strate- 
gies at the college leveL 
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A Product Perspective 

The overriding concept of studying, until recendy, 
stressed the gathering of information from the text. Studying 
was viewed as transferring information from the printed page 
into the student^s memory. It was usually defined as an im- 
proved product— the outcome of overt manipulations by the 
student after reading. 

The major theoretical foundation for this perspective 
came from the nineteenth century storehouse theory of mem- 
ory. James (1890) argued that memory has two storehouses: a 
primary memory, with information an individual is conscious 
of at any given time; and a second?ry memory, with informa- 
tion that is unconscious or that has been absent from conscious- 
ness for some time. 

Waugh and Norman (1965) and Atkinson and Shiffrin 
(1968) extended this storehouse theory to include perception, a 
filter for primary memory. They reasoned that if information 
could be kept active in short term memory Oames's [1890] no- 
tion of primary memory), a comparable trace of information 
would be foi-med in long term nemory (James's notion of sec- 
ondary memory) They held that for this to occur therc must be 
an a priori sensory buffer (i.e., perception) that would bnefly 
store the variety of stimuli that impinge upon the organism. 
This :iensory buffer would allow short term memory (stm) to 
act as a rehearsal buffer in which information could be main- 
tained through recycling while awaiting transfer into long term 
memory (ltm). This model resuitcd in a rather simple theory of 
cognition: the longer a piece of information is active in STM, the 
greater chance it has of being transferred to ltm and thus re- 
membered. 

Instruction in studying was molded to accommodate 
this cognitive product view. The idea v^as that if students could 
be taught to read well, to perceive the correct information (usu- 
ally the main idea and details of the paragraph or passage), and 
to review what they read, information would enter the sensory 
buffer, be transferred to STM, become strengthened through re- 
view, and eventually be stored in ltm. Simply put, if students 
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understood and reviewed what they read, they would tend to 
remember it. Studying was thus defined as locating information 
in the text and, through review, transferring that inforroaiion 
into memory. 

An important component of this model of studying was 
the need to rehearse or review the information in STM to in- 
crease its chances of being transferred into ltm. Several studying 
theorists therefore argued for the need to rehearse information 
after reading. This need has been discussed for several centuries 
in the studying literature. One of the earliest published works 
giving instruction in rehearsal types of studying was The Im- 
provement of the Mind, or a Supplement to the Art of Logic 
(Watts, 1741). Watts argued for a particular study strategy that 
has remarkable similarities to present day study systems. Later» 
Todd (1854) and Porter (1876) began what has become a series 
of student manuals and workbooks chat advocate surveying a 
chapter, setting purposes, becoming an active reader, and, after 
reading, summarizing or discussing the chapter in order to facil- 
itate retendon. 

Little has changed within this theoretical perspective, 
from Watts^s ideas in the eighteenth century to Todd's and Por- 
ter's ide^is in the nine teenth century to Robinson's (1946) no- 
tions of SQ3R in the twentieth century. In more than 200 yca,rs 
of advice, the only change has been the argument that review 
can be more effective if it is spaced or distributed rather than 
massed (Ebbinghaus, 1913; Spitzer, 1939). More recently, other 
theorists have argued in favor of postreading rehearsal strate- 
gies, such as underlining, notetaking, or summarizing (Rickards, 
1980). The basic theory, however, has remained the same. Thus 
the primary study strategy promoted in reading and study skills 
classes and textbooks over the past centur}' has been to identify 
what :he student must know and then have the student review 
that information to remember it. 

A continuing problem with this product perspective and 
with the dual storehouse theory of memory was that the effects 
of rehearsal dissipated after several recall attempts (Weist, 
1972). Also, simple maintenance types of rehearsal were not 
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sufficient to ensure encoding into LfM Qacoby & Bartz, 1972; 
Wickeigren, 1973). It seemed that review was necessary but not 
sufficient to guarantee recall. To address these problems, a new 
theory evolved in the second half of this century. This new 
view is called an information processing theory of cognition as 
it applies to studying (Mayer, 1988b; Schumacher, 1987). 

A Process Perspective 

In the 1950s and 1960s, a well-documented change oc- 
curred in the psychology of learning; the focus shifted away 
from behavioral psychology, or a concern with external stimuli, 
and toward cognitive psychology, or Khc analysis of what has 
been labeled the **black box'' of the brain fMayer, 1988b). The- 
orists posited a four-stage information proj ssing model of cog- 
nition, including acquisition (selective attention in the sensory 
register), encoding (processing in STM and transierring informa- 
tion into LTM), integration (processin;^ in LTM), and retrieval (re- 
call from LTM). This model became the foundation for a second 
perspective on studying. From this model came two theories to 
explain cognitive processing: levels of procc.-5ing theory and 
schema theory. 

Levels of processing theory. Through a series of articles, 
Craik and his associates (Craik ik Lockhart, 1972; Craik & 
Tblving, 1975; Lockhart, Craik, & Jacoby, 1976) stressed that 
deeper, more claborative processing of information in STM dur- 
ing encoding (Ix^ond maintenance types of rehearsal) allowed 
a stronger tr^ce in LTM and a better chance for retrieval. 
Through elaborate rehearsal techniques, they argued, informa- 
tion gathered from the textbook could be identified, organized, 
and encoded in STM to be stored in LTM. 

In a series of studies using a list learning paradigm, sev- 
eral researchers demonstrated that deeper levels of rehearsal 
acted to enhance the chances of recall from LTM (Postman, 
1975). Moreover, they demonstrated that the amount of time a 
person rehearsed information had little bearing on encoding. 
What one did during that rehearsal time was the critical factor 
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Several studying theorists used this levels of processing 
theory as the basis for elaboratlve study strategics. Marton and 
colleagues in Sweden (Marton & Saljo, 1976a, 1976b; Saljo, 
1981), as well as Entwistle and colleagues in England (En t wis- 
tie, Hanley, & Hounsell, 1978; Entwistle, Hanley, & Ratcliffe. 
1979) demonstmted a high correlation between depth of proc- 
essing and depth of understanding when studying. Others used 
the levels of processing theory to explain ihe effectiveness of 
certain study strategies, such as outlining, mapping, network- 
ing, and schematizing (Anderson & Armbuste^, 1980; Brcuker, 
1984; Dansereau et al., 1979b; Weinstein & Mayer, 1985), or 
SQ3R Qacobowitz, 1988; Tidlock. 1978). It was reasoned that if 
students could focus attention on the structure of the concepts 
being presented in the text (a deeper level of processing), they 
could use that structure as an encoding cue for enhancing stor- 
age and retrieval. This process has been labeled the encoding 
specificity principle (Iblving & Thompson, 1973). 

While the levels of processing theor>' is intuitively ac- 
ceptable, criticisms emerged regarding whether students were 
really engaged in deeper levels of rehearsal curing encoding, or 
whether this deepe: processing actually occurred during re 
trievaL Several studies demonstrated that the level of process- 
ing assumed to be used by the reader during encoding was 
often an artifact of the level of processing required by the crite- 
rion task (Craik & Tlilving, 1975; Dark & Loftus. 1976; Morris, 
Bransford, & Franks, 1977). In these studies, students who 
knew that the criterion task required deeper levels of processing 
tended to process the information moix: deeply at the tirrc of 
retrieval, not at the time o. encoding. Processing to fit the crite- 
rion task was labeled the transfer-appropriate processing princi- 
ple (Morris, Bransford. & Franks, 1977) This principle, in 
combination with the encoding specificity principle, became a 
catalyst for a further evolution in the theor>', as shall be seen 
next. 

A second group of studies questioned whether a certain 
level of processing was necessary for effective retrieval. Several 
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studies concluded that retrieval improved only when process- 
ing reached the semantic level (Hyde, 1973; Hyde & Jenkins, 
1969, 1973; Johnson & Jenkins, 1971; Till & Jenkins, 1973; 
Walsh & Jenkins, 1973). Nelson (1977) and Kohlers (1975, 
1976), on the other hand, demonstrated that retrieval could be 
improved even with shallow processing ot connected prose. 
Baddeley (1978) summarized the e\'idence against the levels of 
processing theory as being threefold: (1) no independent means 
acist for measuring whether a student is actually engaged in 
deeper levels of processing; (2) the level of processing needed 
for retrieval is often incotisistent (sometimes a shallow level is 
sufficient while at other times a deeper level is necessary); and 
(3) the hierarchy of processing does not hold up outside the 
paradigm of list-learning experiments. 

These well-founded criticisms lead one to question the 
existence of quantifiably distinct levels of cognitive processing. 
Still, the nature of cognitive processing does suggest that differ- 
ent types of processing seem to be taking place and that these 
different types arc controlled by the individual (Gibbs, Morgan, 
& Taylor, 1982; Rigney, 1978). This conclusion is vital, since it 
suggests that study strategies can be taught to help students con- 
trol their level of cognitive processing during text studying in 
order to foster information acquisition, encoding, integration, 
and retrieval. 

This inability to verify the levels of processing theory, 
along with recent evidence on the contribution made by the 
reader s background knowledge in the orchestration of con- 
structing meaning, caused theorists to consider yet another fac- 
tor in information processing theory. This factor has been 
labeled schema theory. 

Schema theory. This theory is built on evidence that stu- 
dents* background knowledge is used to anticipate and direct 
the processing of print during and after reading. Within this 
theory, textbook studying is defined as an interaction between 
students and the text as students accommodate or assimilate 
their knowledge base to fit their understanding of the text. 
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An important first consideration schema theorists tack- 
led was the form and function of background knowledge. 
Tulving (1972) reasoned that knowledge consists of two sepa- 
rate but interdependent functions: a semantic memory and an 
episodic memory. Semantic memory was denned as what is 
known about a particular concept-^for instance, vocabi.lary in- 
struction. Episodic mcrnory was defined as the sum total of 
contexts (episodes) in which individuals have experienced that 
same concept— for instance, learning vocabulary, reading about 
how to teach it, or actually teaching it. Each context is unique 
to each individual, and together they form the individual's idio- 
syncratic definition of a given concept (in this case, vocabulary 
instruction). 

Tulving further argued that semantic memory is ab- 
stracted from episodic memory. Semantic memory has been de- 
scribed in a variety of forms, ranging from frames to scripts and 
from goals to schemata (de Beaugrand, 19^1). Perhaps the best 
known of these forms are schemata, \ aich often are depicted 
as three-dimensional webs consisting of nodes of information 
and links between these nodes (Anderson, 1983). 

Several lines of cognitive research have investigated the 
effect of engaging schemata before, during, arcl after reading. 
One early line of research was pursued by Bartlett (1932). He 
had subjects read a culturally unconventional passage entitled 
The War of the Ghosts and then attempt to recall the passage 
over varying time periods ranging up to 5 years. The delayed 
itcall protocols reflected several distortions from the original 
story; eventually, a culturally conventional stor^ line emerged. 
Bartlett concluded that this construction of a culturally more 
acceptable story line was the result of the impact of the sub- 
jects' schemata for stories and their cultural view of the world. 

In a more recent second line of cognitive research, 
Chiesi, Spilich, and Voss (1979; and Spilich et al. (1979) indi- 
rectly demonstrated how a schema for a given topic might be 
stronger than a schema for another topic. This finding implies 
the presence of some mechanism for strengthening or develop- 
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ing schemata that would explain how learning occurs. If a 
schema strengthening mechanism does exist, understanding 
how it functions can help us understand the role of background 
knowledge in directing the acquisition, encoding, integration, 
and retrieval processes during studying. 

One interpretation of this schema strengthening mecha- 
nism was provided by Anderson (1976, 1983) in his network 
model of artificial intelligence. He argued that the nodes and 
links that make up schemata are formed through experience 
and are probability based. Specifically, the more experiences 
one has with a given concept, the stronger the probability that 
tiii. concept will be activated (linked) when episodes relevant to 
those e:q)eriences occur. 

For example, if students were to n:ad a passage on the 
concept of slump, they might have a certain probability (say 
around 70 percent) of engaging their background knowledge 
about e7notion (i.e., activating their schemata to link their se- 
mantic knowledge of slump with their semantic knowledge of 
emotion); a higher probability (say around 80 percent) of en- 
gaging their background knowledge of baseball, and so forth. 
Howevei; most of us would predict a rather low probability of 
students constructing a link between the schemata of concrete 
and slump. Creating such a link would be useful only, if, say, 
students in a civil engineering class were studying a manual on 
testing concrete. As the students studied, they would come to 
learn that one test for unhardened concrete is a slump test; thus 
the probability would increase that these students would link 
the concepts slump and concrete. Once these links are made, 
we might say learning has occurred. 

This example demonstrates the role of schemata in an in- 
formation processing theory of studying. For learning to occur 
during studying, existing schemata in the students* knowledge 
base must be accommodated or assimilated to fit incoming in- 
formation during encoding. This development of schemata dur- 
ing ejncoding strengthens the links of activation and increases 
the probability of recall during retrieval. 
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Several studying theorists recently began incorporating 
schema theory In^ their descriptloas of how students study 
and learn through print. Pask (19V6a, 1976b) In England; Biggs 
(1976, 1979, 1980) in Australia. Elshout-Mohr (1983) and 
Breuker (1984) In the Netherlands; and Anderson and 
Armbruster (1984), Dansereau (1978, 1980), Klntsch and van 
Dljk (1978), Rlgney (1978), Vi^clnstein (1977), and Welnsteln 
and Underwood (1985) in the Uniled States began discussing 
how background knowledge is used to drive deep processing 
during encoding. Pask, Biggs, Breuker, as well as Klntsch and 
van Dljk argued that by identifying simlliixltles and differences 
between knowledge in the mind (presumably schemata) and 
knowledge on the page, students engage deep processing tl.'^t 
fosters acquisition and retention. Such processing allows the 
student to identify the superordlnate structure (i.e., higher or- 
der ideas) and tht n use this structure to evaluate incoming in- 
formation. When this occurs, ideas seem to remain active in the 
short term store longer, thus enhancing their chance of transfer- 
ring to the long term store and sti^ngthening the link between 
the pathways in the schema (Klntsch & van Dljk, 1978). 

While several other studies over the past decade demon- 
strated the preeminence of schemata in studying and learning, 
two studies questioned this line of research. These studies 
showed that students coaslstendy adjusted their processing and 
engaged new schemata to fit the criterion task. Bower, Black, 
and Tlirner (1979) and Splro (1977) found that as time passed, 
understanding became less dependent on the text passage and 
more dependent on background knowledge. This was particu- 
larly evident when the title cue was switched at the time of re- 
call. Spiro demonstrated that students reconstructed their recall 
to fit this new title even if it presented a different perspective. 

This consistent presence of the encoding specificity 
principle (Tblving & Thompson, 1973) and the transfer-appro- 
priate processing principle (Morris, Bransford, & Franks, 1977) 
in reading has been argued to be a major factor in interpreting 
the effectiveness of study strategies (Anderson & Armbruster, 
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1984). The encoding specificiiy principle suggests that how a 
student encodes information can act as a cue for recall. Intui- 
tively and theoretically, this idea makes sense. Howei^er, this en- 
coding cue can be overridden by a change in the recall task 
demands (transfer-appropriate processing), and then the encod- 
ing cue becomes less important. So it seems that while the spe- 
cificity of encoding may determine how a student acquires and 
retiins information when studying, the intent of satisfying the 
criterion task at retrieval also affects what tliat student recalls 
(O'Neil, 1978) It seems that the information processing theory 
of studying is nOt sufficient lo exphin all recall situations. 

Another line of research supported the need to modify 
this infomiation processing notion of studying. Dooling and his 
colleagues (Dooling & Christiansen, 1977; Dooling & Lachman, 
1971; Dooling & Mullet, 1973; Sulin & Dooling, 1974) demon- 
strated that when students recall, they construct an interpreta- 
tion consistent with their existing schemata. However, they "'so 
found that students' schemata actually biased their studying, 
pushing them to attend to certain concepts and ignoie others 
This bias is particularly prevalent when students are given a tide 
cue that acts as a catalyst for accessing background knowledge 
about a given topic (Pichert & Anderson, 1977). Of particular 
concern was how this biasing effect might be present m other 
variables of the studying situation besJ cs the schemata of the 
student. This incomplete explanation resulted in the need for 
yet another evolution in study strategy theorj'. 

An Intent Perspective 

This latest evolution resulted in an expanded theory of 
studying that attempted to explain how students adjust their 
processing with the variables of the study situ'*>,.ion. Current 
theorists are consistent in listing four va-iables. (1) the attitudes 
and semantic knowledge students bring to studying; (2) the ma- 
terial studenfs must study; (3) how well students like and use a 
giv^n study strategy; and (4) the purpose for which students are 
studying. 
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During the past decade or so, theorists arid researchers 
began exploring these variables (Anderson, 1973; Brown, 1982; 
Cook & Mayer, 1983; Dansereau, 1980, 1985; Rigney, 1978; 
Simpson, 1984; Smith, 1982; Weinstein & Mayer, 1985; Wein- 
stein & Underwood, 1985;" Wittrock, Marks, & Doctorow, 
1975). Background knowledge was divided into fou* areas: de- 
clarative knowledge (Ryle, 1949), or knowledge of the content; 
procedural knowledge, or knowledge o/ various study strate- 
gies; conditional knowledge, or knowleu^e of when and where 
to apply the strategies; and volitional knowledge of the study 
environment, or knowledge of one's own interests and motiva- 
tions. One explanation of the connection between "hese types 
of knowledge and the criterion task was offered by Dansereau 
(1985), who categorized study strategies as either primary or 
support strategies. Primary study strategies were defined as the 
specific comprehension and retention approaches to studying 
(e.g., declarative and procedural knowledge). Support study 
strategies were defined as the utilization strategies (e.g., condi- 
tional and volitional knowledge) designed to provide a suiiablc 
cognitive climate for studying. 

Another explanation was put forth by Weinstein & 
Mayer (1985), who arranged study strategies into eight catego- 
ries. The first six categories (basic and complex rehearsal, basic 
and complex elaboration, and basic and complex ;rganization 
strategies) refled increasing levels of processing— diat is, proce- 
dural knowledge. The seventh and eight categories (compre- 
hension monitoring stn.tegies and affective/motivational 
strategies) manage processing in Ught of the demands of the ma- 
terial and the criterion task — that is, conditional and volitional 
knowledge. Weinstein and Mayer argued that students use these 
two groups of strategies during studying as they construct an 
interpretation from the text and then match this construction 
with existing declarative knowledge. This two-way interaction, 
they said, explains studying processes. 

However, Dansereau 's (1985) and Weinstein and Mayer *s 
(1985) theoretical explanation fell short when confronted with 
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empirical research riemonstrating that the interaction can occur 
only if the student has learned how to evaluate study strategy 
effectiveness in a variety of material and criterion task de- 
mands. Studying has been shown to be developmental, with 
older, mature studiers more likely to adjust their strategies to 
the material and criterion task than younger, immature studiers 
(Biggs, 1979; Brown, 1982). This finding suggested that stu- 
dents can be taught how to use study strategies. Therefore, an 
instructional variable needed to be added to form a three-way 
interaction between the student, the material, and the 
instruction (or orienting task). 

During this same period, other theorists and researchers 
explored a different three-way interaction between the student, 
the material, and the criterion task. Meyer, Brandt, and Bluth 
(1980), Smith (1982), Baker and Brown (1984), and Breuker 
(1984) demonstrated that both the quality of the material and 
the type of criterion test used affected students' success with a 
given study strategy. Meyer, Brandt, and Bluth pointed out dif- 
ferences between good and poor readers' ability to recognize 
structural patterns in the text 3S well as their ability to use these 
patterns to adjust processing and facilitate recall. Smith found 
that when graduate students were faced with difficult material 
outside their background knowledge, they employed five sets 
of activities as they developed a study plan. This plan varied 
among students depending on their individual characteristics. It 
was conux)lled by self-imposed goals based on students' inter- 
pretation of the criterion task s context and their own needs, 
and it changed as decisions were made regarding their progress 
toward reaching their goals. Baker and Brown demonstrated 
that students metacognitively adjust their processing to fit the 
text before, during, and after reading. This metacognitive 
knowledge includes students' ability to attend to important 
ideas and ignore trivial ideas, as determined by the criterion 
task. xJreuker argued that students must identify the underlying 
spatial relationships (schema) of the text in order to match this 
structure with their prior knowledge during encoding. 

Still, this new thK:e-way interaction did not seem to fully 
explain the effect of studying. For example, some students did 
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not succeed during experiments in which their background 
knowledge was engaged, the material was deemed easy, and 
they knew the demands of the criterion task (Davis & Annis, 
1976) Ford (198 1) argued that part of the reason for this incon- 
sistency was that the criterion task variable of the studying situ- 
ation was defined in a limited sense— often, simply as the test 
the student must fece. Ford extended this definition to include 
the affective values a student places on what is to be learned, 
including the reasons for learning (beyond the immediate need 
to pass a test or a course). Students, for example, ofte.i evaluate 
certain information they are learning according to how it helps 
them satisfy some of their life's values, or how they think the 
information will fit into their lives beyond school. Ford argued 
that such values should be taken into account when consider- 
ing the processing strategies students should use. 

Because theory and research argue for the need to in- 
clude all variables of the study situation in a complete theorj' of 
studying, most theorists currently are suggesting that the intent 
perspective should include a four-way interaction between the 
student, the material, the orienting task, and the criterion task 
variables (Anderson & Armbruster, 1984; Campione & 
Armbruster, 1985; Levin, 1986; McKeachie, 1988; Paris, 1988; 
Rohwer, 1984; Schumacher, 1987; T ssmer & Jonassen, 1988-' 
Thomas & Rohwer, 1986; Wade & Reynolds, 1989; Wittrock, 
1988). This intent perspective suggests that it is no longer nec- 
essary to explore whether a given study strategy works when aJ 
the study variables are controlled in an empirical setting. 
Rather, what must be determined is how to teach students to 
perceive all the variables that will affect the study situation, 
how to select a study strategy or orienting task to fit that per- 
ception, and how to monitor their progress toward satisfying 
that perception. To do so, it is necessary to understand how the 
individual and combined study variables affect study strategies. 

Conclusions from the Theory 

A definition of studying from a product or process per- 
spective limits the investigation of studying to learning from 
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studying. The intent perspective provides a more productive 
definition of studying thac includes learning through studying. 
To do this, students must intentionally select a study strategy 
that uses the text as a tool for thinking and for expanding their 
background knowledge as they attempt to satisfy their percep- 
tions of the criterion task. If we examine the literature on text- 
book studying from this intent perspective, we can draw sound 
conclusions about when and where study strategies will work. 

Methodology for This Review 

As chronicled earlier, several authors have attempted to 
evaluate the empirical literature on study strategies. These au- 
thors' efforts give us a foundation for verifying this intent per- 
spective of study. This theory is generally visually represented 
by a tetrahedral model proposed by Jenkins (1979) and by 
Bransford (1979) to examine the literature in cognitive psychol- 
ogy. Later, Brown (ly80) used this same model to illustrate the 
reading literature in general. Recently Brown, Campione, and 
Day (1981), McKeachie (1988), and Nist (1985) have adapted 
the model to illustrate the work in college reading and study 
strategies. We interpret the tetrahedral model as depicting the 
four sets of variables that affect the choice of study strategy: the 
student, the material, the orienting task, and the criterion task 
(Figure 2). 

Each of the four vertices of this figure represents a clus- 
ter of variables stuuv^nts must consider when choosing a study 
strategy for any study situation. Sometimes, however, only one 
edge of this figure is taught, thus representing to students a sim- 
ple two-way interaction that leaves out two of these variables. 
For instance, we imply that studying involves interaction only 
between the student and the material when we teach poor read- 
ers to select one study strategy lO study a biology textbook and 
a different strategy to study a novel. 

Other times, one plane of this llgure is taught, thus rep- 
resenting a three-way interaction between variables. For in- 
stance, we imply that studying involves interaction only 



erJo 



Caverly and Orlando 



Figure 2 

ctrahedral Model for Research on Studying 



student 



material 




orienting 
task 



between the student, the material, and the criterion task when 
we teach poor readers to select one study strategy to prepare 
for an essay exam on a novel and a different study strategy to 
prepare for a multiple choice exam on a biology textbook. 

Seldom do we teach students to be aware of the interac- 
tior* among all four edges and all four planes of this model- 
that is, the four- way interaction, or metacognitive awareness 
(Wade & Reynolds, 1989) present when we teach poor readers 
to metacogniti^ ely evaluate the success of their strategy choice 
when studying a biology textbook una a novel for the different 
types of examinations. 
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Framework for Discussion 

We used the four clusters of variables in the tetrahedral 
model as a framework for reviewing the empidcal literature sur- 
rounding study strategies. Once the research results were evi- 
dent, we were able to identi'/y the results of the two-way, 
three-way, and four-way interactions of these clusters of varia- 
bles. 

We begin with a discussion of how student variables 
were manipulated or controlled in the experiments discussed in 
the liremlure. That is, what skills and abilities did students bring 
with them to the experimental study situation, and how did 
these variables affect what they learned? Although students 
bring a variety of attributes to any study situation, two variables 
have been singled out in the theoretical literature as important 
to studying: (1) the stud'^nts' reading ability, and (2) whether 
the students' background knowledge was taken into account. 
(Other student variables are reviewed in Chapter 5 of this vol- 
ume.) 

The second cluster of variables to be considered involves 
how the material was manipulated or controlled in 'he experi- 
ments. Can it be determined if a given study strategy would be 
equally effective in all types of material students must study? 
Four important material variables are highlighted in the theoret- 
ical literature on studying: (1) the content or subject matter, (2) 
the readability or difficulty of the text, (3) the length of the ma- 
terial, and (4) the explicitness of the structure. 

A third cluster of variables is the extent to which the ori- 
enting task was manipulated or controlled. That is, how did the 
means by which the strategy was taught affect how students 
performed? Three variables emphasized in the theoretical litera- 
ture on studying are: (1) whether students wer. taught to re- 
view the material after study but before the criterion task, (2) 
whether they received any instruction in the use of the study 
strategy, and (3) whether students had criterion task know ledge 
before they studied. 

Finally, this model suggests that how the criterion task 
was manipulated or controlled must be evaluated. Was perform- 
ance measured after students used a study strategy? Two impor- 
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tant variables indicated by the theoretical literatuiv studying 
are: (1) the test /ype— whether the test measured recognition, 
recall, or both, and (2) tne test administration delay, or the 
amount of time that elapsed between use of the study strategy 
and administration of the test. 

It is our premise that this teCrahedral model, with four 
clusters of 11 variables, provides an initial set of criteria for re- 
viewing empirical research, drawing conclusions, and deter- 
mining implications for additional research and sound 
instruction. In order to bring some semblance of order to this 
process, an integrative review Qackson, 1980) using the tetrahc- 
dral model was completed. Our primary research question for 
this integratrVe rcvicvv' was how effective and efficient specific 
study strategies are in light of individual and interactive effects 
of the four clusters of variables. In order to answer this ques- 
tion, we examined standard primary sources as well as second- 
ary sources such as Current Index to^ >umais in Education, 
Dissertation Abstracts International, and Resources in Educa- 
tion. We also made use of individual literature reviews within 
specific studies. 

Note that no study was included in the rc\iew if the sub- 
jects in the study were younger than high school age. We had 
several reasons for imposing this limitation. Brown's (1982) re- 
search suggests that most older students perform better than 
younger students because they have a higher level of cognitive 
development. Moreover, Perrj' (1970) argues that the demands 
of college are different from those of earlier grades, causing sig- 
nificant cognitive growth on tlK part of the student. Finally, our 
intent ib to dra'A^ conclusions and impliciitions only for college- 
age populations, and we do not believe that doing so with re- 
search completed on younger populations i.* appropriate. 
Within these limitations, we were able to find more than 500 
empirical studies and reviews from which to draw conclusioi:5 



Study Strategies Examined 

A casual review of the literature indicates that students 
can use many strategies when studying. However, in a theoreti- 
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cal analysis, Weinstcin & Mayer (1985) contend that the param- 
eters of these study strategies arc limited. They outline eight 
major categories of study strategies that are available to 
studenf:s: 

• basic rehearsal strategies — techniques for repeating a 
list ot items, such as common memorizing; 

• complex rehearsal strategies— techniques for high- 
lighting material t be learned, such as underlining; 

• basic elaboration stategies — techniques for generating 
mental images to remember, such as imaging; 

• complex elaboration strategies — techniques for de- 
scribing how new information fits into old knowl- 
edge, such as generative notetaking; 

• basic organizauonal strategies — techniques for group- 
ing lists of items, such as mnemonics; 

• complex organizational strategies — techniques for 
recognizing and recalling the structure of the informa- 
tion, such as outlining or mapping; 

• comprehension monitoring strategies — technique's for 
establishing a learning goal and monitoring one's 
progress toward that goal, such as SQ:>R; 

• affective and motivation strategies — techniques for 
controlling volitional strategies, such as attention, 
concentration, anxiety, and time management 

Sur\'eys of materials and student usage at the college level con- 
firm that these eight categories of study strategies are indeed the 
most commonly used (Annis & Annis, 1982; Fairbanks, 1973; 
Risko, Alvarez, & Fairbanks, this volume; Sanders, 1979). 

To focus this review on study strategies for textbooks, 
we will use the tetrahcdral model and an integrative review pro- 
cedure to examine five strategies in four of these categories; un- 
derlining as indicative of complex rehearsal strategies, 
generative notetaking as indicative of complex elaboration strat- 
egics, outlining and mapping as indicative of complex organiza- 
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tional strategics, and SQ3r as indicative of comprehension 
mooitorvng strategics. (Other comprehension monitoring strate- 
gics J»re reviewed in Chapter 2 of this volume; affective and mo- 
tivation strategics are reviewed in Chapter 6.) The folic Ang 
sections first review previous findings surrounding these strate- 
gies as they relate to the variables of the tetrahedral model. Next 
th4' discuss what new e\idcncc was uncovered in this review. 
Finally, they offer conclusions and implications for instruction. 



Complex Rehearsal Strategy: UnderKning 

Underlining or highlighting 0^^'reafter called simply un- 
derlining) is representative of what \X^einsiein and Mayer (1985) 
call complex rehearsal strategics. This type of study stmtegy m- 
volves selecting important material and encoding it tfirough 
subsequent rehearsal. 

Underlining has grown in popularity to become one of 
the most ubiquitous strategics used in postsecondary schools. 
In the early part of this century, only 4 percent of college stu- 
dents underlined their textbooks (Charters, 1925). More re- 
cently, survej's have shown varying levels of underlining use 
among college students, ranging from 97 percent (Adams, 
1969), to 92 percent (Fowler & Barker, 1974), to 63 percent 
(Annis & Annis, 1982). Such a proliferation in the use of under- 
lining runs counter to the "^uments made in past decades 
against this strategy both by theorists (Berg & Ren tie, 1966; 
Crawford, 1938) ?nd by study skil' cxtbook authors (Brown- 
ing, 1976; Laycock & Russell, 1941). More recent study skill 
text authors have begun again to argue in favor of underlining 
(Radencich & Schumm, 1984). 

A summary of the conclusions made by those who have 
reviewed the underlining literature (Anderson & Armbruster, 
1984; Brown, 1982; Browning, 1976; Cook & Mayer, 1983; 
Rickards, 1980; Simpson, 1984; Tessmer & Jonassen, 1988; 
Wcinstein & Mayer, 1985) provides support for using the 
tetrahedral model in our review. In applying the model to the 
underlining strategy, one student varir^ble, two material varia* 
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bles, and three orienting task variables can be identified from 
these reviews. 

The student variable that these literature reviews seemed 
to emphasize was that there seems to be a distinct developmen- 
tal trend in students' ability to use underlining to select relevant 
parts of the chapter. Younger students (or, for our purposes, less 
able studiers) do not spontaneously underline high structural 
concepts (i.e., main ideas). Rather, they tend to underline sen- 
tences at random. These reviewers conclude that students must 
be able to recognize the hierarchical structure inherent in a pas- 
sage before underlining can be an effective strategy for recall. 

The first material variable identified in these reviews re- 
lates to the structure of the material. It seems that the more ex- 
plicit the structure of a passage, the greater success students will 
have with underlining. If the material provides clues to high 
structural concepts— for instance, with subtitles, subheadings, 
or italics— and the student is developm en tally mature enough 
to recognize such clues, underlining seems to foster recall not 
only of the high structural ideas but also of low structural ideas 
(i.e., ideas that uiC not emphasized explicitly). In other words, 
the student need not underline the lower order ideas to facili- 
tate recall of them. This success, however, may be more an arti- 
fact of recognizing that certain ideas are inclusive of others than 
of the act of marking the text. P^vious research has shown sim- 
ilar benefits of recognizing high structural ideas in the recall of 
low structural ideas when underlining was not allowed (Meyer, 
1977, 1979). Nevertheless, this is an example of an interaction 
between two variables on the tetrahedral model— the student 
and the material. 

The second material variable relates to the difficulty of 
the passage. Passage difficulty (typically determined by a read- 
ability formula) also is a factor in the use and success of under- 
lining. When students are given a choice of study strategies to 
use, they are more likely to use underlining with a harder pas- 
sage than with easier material, regardless of their ability. When 
students perceive a passage to be easy, they do not feel they 
need to perform any study strategy to remember it. When they 
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perceive it to be difficult, underlining is One of the first strate- 
gies they will spontaneously select, often irrespective of its ben- 
efit. Here, the previous reviews suggest an interaction in the 
tetrahedral model on the plane between orienting task, mate- 
rial, and criterion task. If students perceive a passage to be diffi- 
cult and the criterion task to require recall, they will select 
underlining as a strategy. If they perceive the passage to be easy, 
they will not choose to use underlining or any other overt 
study strategy— whether or not the criterion task requires 
recall. 

Some orienting task variables have also been identified, 
although they have not been thoroughly verified. First, if un- 
derlining is to be effective, only one idea in each paragraph 
should be underlined. These reviews argue that instructing stu- 
dents to underline one idea per paragraph fosters deeper proc- 
essing since the student must select the most important concept 
to underline. The second variable is that the success of under- 
lining (as measured by subsequent criterio. tests) seems to de- 
pend on the quality and extent of instruction on how to 
underline the most important concept. Finally, it has been.sug- 
gested that if the material is encoded (underlined) to fit the cri- 
terion task, both intentional and incidental recall may be 
fostered. This is an exam.ple of an interaction on the tetrahedral 
model's edge between the orienting task and the criterion task 
variables. 

We will now take a closer look at the empirical literature 
using the variables indicated by the tetrahedral model. In our 
review of the literature, we found 30 publications that reported 
31 separate experiments exploring the effect of student-gener- 
ated, underlining; Adams (1969), Annis & Davis (1978), Arnold 
(1942), Blanchard & Mikkelson (1987), Brady & Rickards 
(1979), Brown & Smiley (1977), Craik & Martin (1980), Crewe 
(1968), Davis & Annis (1976), Earp (1959), Fairbanks & Cpstello 
(1977), Fass & Scnumacher (1978), Fowler & Barker (1974), 
Friedman & Wilson (1975), Mynn (1978), Hakstain 1971), 
Holmes (1972), Idstein & Jenkins (1972), Kulhavy, Dyer, & 
Silver (1975), Mathews (1938), McKune (1958), Nist & Hogrebe 
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(1987), Rickards & August (1975), Schnell & Rocchio (1978), 
Smart & Bruning (1973), Snyder (1984), Stordahl & Christensen 
(1956), Todd & Kessler, (1971), Weatherly (1978), and Willmore 
(1966). 

We found many other studies on underlining in the liter- 
ature in which students received experimenter-generated un- 
derlined text or in which students completed surveys on their 
use of study strategies. We did not include the survey reports in 
our analysis because they do not address strategy effectiveness. 
And we felt that the studies using experimenter-generated 
marks, while exploring the effect of underlining on recall in 
general, had little relationship to what we might teach students 
to do themselves. Moreover, student-generated underlining has 
consistently proved more effective than experimenter-gener- 
ated underlining (Browning, 1976). Therefore, we chose to 
look only at those experiments in which students marked the 
material themselves. 

Student Varlqbies 

Although several student variables are addressed in the 
underlining literature, we will focus on reading ability and 
background knowledge. One clear finding is that teaching the 
use of underlining to students below a certain level of reading 
ability is not appropriate. This conclusion is evident in the re- 
search of Brown and Smiley (1977) and Schnell and Rocchio 
(1978), who examined immature readers. Their evidence sug- 
gests that underlining is effective with younger or less able stu- 
dents only if they spontaneously selected that strategy by 
themselves. Spontaneous use of underlining is indicative of stu- 
dents' belief in the strategy's effectiveness and of the students' 
level of metacognitive development. For our purposes, this sug- 
gests that students should reach a certain level of development 
in reading before underlining can be an effective study strategy. 

Further evidence of the importance of this variable has 
emerged from the research of those who have looked directly 
at reading ability. This research suggests that reading ability cor- 
relates highly with success with underlining (Holmes. 1972; 
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Todd &Kessler, 1971; Weatherly, 1978). This relationship 
seems to be curvilinear, however; in all but one study (McKune, 
1958), underlining was found to hinder better readers, as it 
tended to interfere with existing strategies. Underlining also 
tended to hinder poorer readers, since it was not sufficient to 
overcome lack of reading ability (Arnold, 1942; Blanchard & 
Mikkelson, 1987; Crewe, 1968; Holmes, 1972; Nist & Hogreb^, 
1987; Tbdd & Kessler, 1971; Schnell & Rocchio, 1978; Snyder, 
1984; Stordahl & Christensen, 1956; Weatherly, 1978; 
Willmorc, 1966). 

Conclusions regarding the effect of reading ability on 
underlining must be tempered, since less than a third of the 
studies reviewed considered reading ability. Still, evidence from 
an examination of students* academic aptitude (as measured by 
college entrance tests) supports these conclusions: students 
who scored higher on academic aptitude tests tended to per- 
form better on reading tests regardless of the study strategy they 
were asked to use (Hakstain, 1971; McKune, 1958; Stordahl & 
Christensen, 1956). While this is not a variable we will examine 
throughout this review, the evidence suggests that the level of 
students' ability (whether it be exhibited in reading ability or in 
academic aptitude) is an important factor to consider when 
teaching the use of underlining as a study strategy. 

The effect of background knowledge on underlining 
generally seems to be positive, although the evidence is bcanty 
Four studies chose to control for the variable of background 
knowledge by *sing it as a covariate (Arnold, 1942; Crewe, 
1968; Pass & Schumacher, 1978; Stordahl & Christensen, 
1956). This technique, however, serves to factor out the vari- 
ance explained by backgn and knowledge and consequently re- 
duces the chances that students using underlining will show 
any increase in performance scores. This factor may have been 
the reason for the lack of improvement in performance found 
in the Arnold or the Stordahl and Christensen studies. 

Three other experiments (Davis & Annis, 1976; Nist & 
Hogrebe, 1987; Snyder, 1984) actually manipulated back- 
ground knowledge within their studies and found that strong 
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background knowledge can facilitate underlining, lack of back- 
ground knowledge cannot be overcome by underlining, and in- 
ducing students to engage their background knowledge does 
not necessarily foster recall. These seenrJngly contradictory 
results might be explained by the lack of adequate strategies for 
inducing students to engage background knowledge (Caverly, 
1982; Paris, 1988; Schumacher, 1987). If background knowl- 
edge is engaged effectively, it might serve to reduce the amount 
of text underlined by improving the students' ability to select 
only high structural ideas, and thus facilitate recall. 

In summary, we can draw three conclusions about the 
effect of student variables on underlining: 

1. Teaching the use of underlin'ng to students who have 
a low level of reading ability is not appropriate. 

2. The relationship between reading ability and under- 
lining is curvilinear, hindering both better and poorer 
readers and assisting only average readers. 

3. The effect of engaging background knowledge is un- 
clear If background knowledge is engaged before or 
during reading, underlining may facilitate recall by 
directing the students' attention to high structural 
ideas. 

Material Variables 

The material variables surrounding the underlining strat- 
egy have not been as thoroughly researched as the student vari- 
ables, In the studies we reviewed, nine different content areas 
were used, with the large majority covering social science top- 
ics. These researchers' emphasis on social science topics may 
be appropriate, given that the largest quantity of reading re- 
quired by students at the college level is often in the social sci- 
ences (Caverly & Orlando, 1985). Still, the research reviewed 
presents no evidence that the underlining strategy is more effec- 
tive with any particular type of expo.^^itcr)' material. The studies 
that manipulated this material variable (HaKstain, 19T'l, Idstein 
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& Jenkins, 1972; Stordahl & Christensen, 1956) found no con- 
sistent effect for content area on students' performance with 
underlining. 

It has been hypothesized (Rohwer, 1984; Schumacher, 
1987) that the demands of the material (i.e., readability/diffi- 
culty level, length of the passage, explicitness of the structure, 
and relevance for the student) should affect how well underlin- 
ing works, particularly since reading ability seems to be a factor 
in the effectiveness of underlining. It has been reasoned that if 
the demands of the matenal are great, underlining should allow 
external storage of the ideas gathered, thus facilitating later re- 
view and reducing the processing demands (Rickards, 1980). 
Therefore, it would be prudent to manipulate the interaction 
between the subject and the material variables when attempting 
to determine the effectiveness of the underlining strategy. 

Only a third of the studies we reviewed discussed the 
difficulty of the material used. In those studies, the krge major- 
ity of passages were below the reading levd of the students. 
Only one experiment (Pass & Schumacher, 1978) actually ma- 
nipulated the difficulty of the material, this study found that un- 
derlining was more helpful with material deemed harder than 
with material deemed easy. This difference, however, may be 
due more to the interaction between the ability of the student 
and the explicit stui^ture of the material than to the success of 
the strategy. With the paucity of research exploring this subject/ 
material interaction, no definitive conclusions can be dixiwn. 

In terms of the length of the material, the passages in the 
studies reviewed ranged from 44 words (Todd & Kessler, 1971) 
to more than 6,000 words (Idstein & Jenkins, 1972). Our review 
indicates that when the material is longer, the effectiveness of 
underlining dimini les. Todd and Kessler as well as Brown and 
Smiley (1977) ^'^ported underlining to be more effective in 
shorter material, while Idstein and Jenkins demonstrated under- 
lining to be less effective in longer pas ages. Still, questions 
must be raised regarding the generalizability of research in 
which passages of fewer than 500 words were used when it is 
u., likely that students will have to study material that short. 
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Further evidence still needs to be garnered to support the effect 
of the length of the material being underlined. 

Finally, only seven studies considered the explicitness of 
the materiars structure. Of these, only the Rickards and August 
(1975) study found that explicit structure interfered with the 
effectiveness of underlining. Several other studies (Brady & 
Rickards, 1979; Brown & Smiley, 1977; Earp, 1959; Weatherly, 
1978) found no such detrimental effect. This inconsistency 
might be explained by exploring the student/material/orienting 
task plane of interactions on the tetrahedral model. None of 
these seven studies spent more than 1 hour teaching students 
how to underline— how to select the major concepts and mark 
them. This knowledge could result in students' processing the 
information at a deeper level (Wark & Mogen, 1970). According 
to the intent theory of studying, students need to be able to 
impose an implicit structure onto the material as an encoding 
device for later recail if no explicit structure is available. The 
reasoning behind this argument is that the imposition of an im- 
plicit structure leads to deeper processing and creates an encod- 
ing-specific device for enhancing recall. This idea has not been 
tested in the literature on underlining. 

In summary, four conclusions can be drawn about the 
effect of material variables on underlining: 

1. Since most studies used social science material, and 
few manipulated content area, the effect of content 
on the effectiveness of underlining cannot be deter- 
mined. 

2. Underlining may be more effective with harder pas- 
sages; however, little research has manipulated this 
variable. 

3. Underlining seems to be less effective in longer mate- 
rial (more than 500 words). 

4. Contradictory results with structurally explicit mate- 
rial may be due to researchers* failure to provide suf- 
ficient instruction in underlining (a material/orienting 
task interaction). 
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Orienting Task Variables 

An analysis of the orienting ta5k variables verifies that 
these variables have some distinct effects on underlining. For 
example, strong evidence suppom 'he notion that underlining 
provides students with an efr^LtKe ii:eans of reviewing material 
either after reading or before the test (Annis & Davis, 1978; 
Brown & Smiley, 1977; Crewe, 1968; Davis & Annis, 1976; 
Fowler & Barker, 1974; Holmes, 1972; Idstein & Jenkins, 1972; 
Tbdd & Kessler, 1971; Willmore, 1966). In those studies that 
actually manipulated the review factor (Brown & Smiley; 
Crewe; Idstein & Jenkins), the longer and more thorough the 
review, the better the perfomiance. A simple review does not 
seem adequate even with older students, as illustrated in the 
Crown and Smiley study. 

Further evidence makes clear the need to teach underlin- 
ing as a strategy. The l6 studies that taught underlining she ved 
either statistical significance oi a distinct trend favoring under- 
lining over other study strategies. In only 6 of these studies 
were more than 2 hours spent on teaching underlining. The 
amount of time spent on instruction may not make much dif- 
ference; for example. Holmes (1972) taught his students for up 
to 8 hours, but this still was not enough to bring about im- 
proved performance. However, if we look at the interaction in 
his study between the subject and orienting task variables, we 
realize that he controlled for reading ability, thus reducing the 
chance that any variance would surface showing the impact of 
instruction on the underlining strategy's effectiveness. More- 
over, the passage used in this study was approximately 5,000 
words long, which also could have reduced the effectiveness of 
underlining, particularly since students were not allowed to re- 
view the passage. After considering these studies, it is apparent 
that just teaching underlining as a study strategy for a given 
amount of time is not sufficient to give an accurate understand- 
ing of its role in enhancing students' performance. 

An additional instructional variable that has been identi- 
fied is the need to teach students to alter processing to fit the 
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criterion task. The interaction between orienting task and crite- 
rion task that came to light in our review suggeus that underlin- 
ing can foster intentional recall (Fowler & Barker, 1974; 
McKune, 1958; Smart & Bruning, 1973) but hinder incidental 
recall (Kulhavy, Dyer, & Silver, 1975; Rickards & August, 1975). 
Only Brady and Rickards (1979) found a positive incidental ef- 
fect with underlining. Therefore, it is important that students 
know what type of criterion test they will have to pass before 
selecting underlining as a study strategy. 

In summary, we can draw three conclusions about the 
effect of orienting task variables on underlining: 

1. Teaching scudents to review what they have under- 
lined before giving them a test markedly improves 
their performance. 

2. Providing students with even a limited amount of in- 
struction in underlining covering the selection of 
high structural ideas and the need to review is impor- 
tant for enhanced performance. 

3. Students should be taught how to alter thdr underhn- 
ing strategy on the basis of their knowledge of the 
'criterion task. 

Criterion 7osk Variables 

In this review, we found a strc^g orienting task/criterion 
task interaction. Out of the 31 studies we reviewed, 21 found 
improvement on eithei a recognition or a recall type of test fol- 
lowing underlining. A closer examination reveals that much of 
this success may be due to review, since l4 of the 21 studies 
allowed an opportunity for review. Conversely, ^nly 3 of the 10 
studies that found no improvement provided students with an 
opportunity to review. In the 7 studies that found improved cri- 
terion task performance following underlining but that did not 
allow students to review what they underlined, success may 
have resulted from instruction, the students' reading ability and 
motivation levels, and the explicit structure of the material. 
These studies suggest a student/material/orienting task/criterion 
task interaction that should be explored further. 
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In tenns of the time lag between studying and test ad- 
ministration, 24 tests were delayed, with the gap ranging from 5 
minutes (Brown & Smiley, 1977) to 47 days (Crew^e, 1968). No 
clear pattern emerged from these studies. However, a meta- 
analysis of the data (Caverly, 1985) suggests a slight increase in 
positive effect for underlining when compared with no under- 
lining as the delay in testing becomes longer. This meta-analysis 
also suggests that underlining seems to be more effective for in- 
tentional recall tasks than for incidental recall; the effect scores 
were +0.25 and + 0.05, respectively. Here, again, we see a po- 
tential interaction between orienting task and criterion task var- 
iables. 

In summary, we can draw these conclusions about the 
effect of criterion task variables on underlining: 

1. Underlining seems to be effective for either recogni- 
tion or recall tests if review is allowed. 

2. The tendency is that the greater the delay in testing, 
the greater the effect of underlining as compared 
with no underlining. 



Summary 

Based on this review, underlining may be considered an 
effective strategy if students find success with it and conse- 
quently prefer to use it over other strategies. Underlining 
should not be taught to students who are not dcvdopmentally 
ready to use it (i.e., those who are unable to recognize high 
structural ideas); underlining cannot overcome poor reading 
ability. For those students ready to use underlining, instruction 
empliasizing a strategic approach is important. Students must be 
taught how to underline only the most important concepts 
bii:-ed on the explicit or implicit structure of the text and on the 
criterion demands. They must also be taught to process infor- 
mation on a deeper level to satisfy their intent, only then can 
the encoding function of underlining emerge. Finally, student^ 
must be taught to regularly review what they have underlined if 
remembering is a goal. 
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Complex Elaboration Strategy: 
Notetoking 

Another major group of study strategics are what 
Wcinstein and Mayer (1985) call complex elaboration strategics. 
This type of strategy allows students to monitor their vender- 
standing during and after reading by fostering recognition and 
elaboration of the material. Several such strategies are available 
to college-level students; perhaps the most commonly used is 
notetaking, in which students rewrite either in the margin of 
the textbook or on separate sheets of paper what they leain 
from reading. These notes can take several forms, ranging from 
verbatim accounts to notations that represent the structure of 
the infomiation (Eanet & Manzo, 1976). 

Most analyses of notetaking (Carrier & Titus, 1979; 
Hartley & Davies, 1978) have drrtwn conclusions from research 
that has examined both notetaking from lectures and notetaking 
from textbooks; that is, notetaking while listening and notetak- 
ing while reading. We believe that while listening and reading 
are reciprocal processes they are not identical. Conclusions 
drawn from a transitory process such as listening are not neces- 
sarily adaptable to a protracted process such as reading. For ex- 
ample, with listening it is difficult (if nOt impossible) to stop the 
input in order to consider what is being learned. With reading, 
the input can be halted at any point to review the message and 
think about what is being learned. Therefore, the process and 
the intent of notetaking while listening to a lecture are different 
from those of notetaking while reading a text. The analysis pre- 
sented here examines only research dealing with notetaking 
from text. (For a discussion of notetaking from lectures, see 
Chapter 4 of this volume.) 

Previous analyses (Anderson & Armbruster, 1982; Cook 
& Mayer, 1983; Rickards, 1980) support the use of the tetrahe- 
dral model Tor exploring the research on notetaking. Two inter- 
actions between variables on the tetrahedral model have been 
discovered; one between the orienting task and the criterion 
task variables and a second among the subject, the orienting 
task, and the criterion task variables. 
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Rickards (1980), in analyzing the literature on notetaking 
from textbooks and lectures, found an orienting task/criterion 
task interaction. He concluded that success on recognition 
types of criterion tasks following notetaking was a factor of en- 
coding the information during processing. However, when re- 
call types of criterion tasks were used, having the material 
available for review seemed to be necessary. He also found that 
a factor he called **test mode expectancy" affected success, 
concluding that students' quality of notes differed depending 
on whether they expected a recognition or a recall test. Those 
expecting a recall test tended to take notes on higli structural 
information (i.e., information important to the overall meaning 
of the material), while those expecting a recognition test did 
not. Finally, Rickards suggests a student/orienting task/criterion 
task interaction. He found that students* notes varied in quan- 
tity and in level of structural importance, depending on the 
types of criterion task expected. He also found thai students* 
success with notetaking depended on whether they demon- 
strated high or low ability and on whether they would sponta- 
neously use notetaking when given the opportunity. 

Anderson and Arnibruster (1982) concluded that an ori- 
enting task/criterion task interaction may explain notetaking's 
lack of effectiveness when compared with stud)' strategies such 
as rereading or underlining. Students in the studies analysed 
may not have been encoding the information to fit the criterion 
task. These researchers found that in most studies, students 
were given a limited amount of time to read the text and de- 
velop notes. This limit was often imposed by researchers in an 
effort to keep consLint the amoui.c of time-on-task spent on 
notetaking, rere?.diiig, and underlining. Because of this limited 
study time, many of the students who used notetaking may 
have decided to alloca .e their attention to processing the main 
ic'.eas at the expense of the details. (This ide^ is based on Ander- 
son and Armbruster*s assumption that nctetaking takes more 
{ime than rereading or underlining.) In these studies, the stu- 
dents who used rereading or underlining ma) ha\ e distributed 
their study time and effort over the entire passage. This differ- 
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cnce in orien .ing task may have given those students using re- 
reading or underlining an unfair rJvantage on criterion tasks 
that measured details. Moreover, if the criterion task was a free 
recall task, students using a notctaking study strategy would 
tend to produce fewer ideas (without respect to the level of 
idea) than students who processed the entire passage tlirough a 
rereading or underlining study strategy. 

Anderson and Armbruster (1982) also reasoned that if 
the students chose to process the information at a deeper le\'el 
through notes that reflected the structure of the text (Eanet & 
Manzo, 1976), a test measuring recall accuracy may not show 
any positive effect for notctaking, since deeper processing 
would accentuate distortions and intrusions in the recall proto- 
col. This interaction between the orienting task and criterion 
task variables caused Anderson and Armuruster to conclude 
that notctaking can be an effective study strategy if it entails se- 
iC!ctive attention and encoding that is compatible with the crite- 
rion task. 

Cook and Mayer (1983) also found an interaction be- 
tween the orienting task and criterion task variables. They con- 
cluded from their analysis that notctaking tended to foster 
selective attention during text processing and thus encouraged 
intentional Icarring. When students were conrained in their 
processing by the rate of presentation or by the information 
d\*:nsity of the material (hinting at a three-way interaction bc- 
twec'n the orienting task, material, and criterion task variables),, 
notctaking could focus attention only on main ideas. Subse 
qucnt criterion tasks in the studies they analyzed may not hav< 
been sensitive enough to measure this factor. In studies that re- 
duced the strain on students' processing capacity, and in those 
that allowed review before the criterion task, the performance 
of students using notctaking improved. 

Cook and Mayer (1983) also found another two-way in- 
teraction between the orienting task and criterion task varia- 
bles. They found that under some conditions, notctaking could 
help students organize the material, enhancing what they call 
"construction'' (integration of new knowledge with existing 
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schemata). If the information was constructed into a student's 
memory, the criterion task reflected increased inferencing and 
an improved ability to apply the information. The researchers 
concluded that if students took structural notes (notes that re- 
flected the structure between the ideas), they had a greater 
chance of constructing information during processing and of 
improving their performance on criterion tasks measuring in- 
ferencing and application. 

We will now focus on the literature on taking notes from 
textbooks. Our analysis identified 27 itporis with 30 experi- 
ments examining this study strategy: Annis (1979), Annis & 
Davis (1978), Arnold (1942), Breezing & Kulhavy (1979, 1981), 
Brown & Smiley (1977), Caverly (198^,). Davis & Annis (1976), 
Dyer, Riley, & Yenkovich (1979), Fox & Siedow (1985), Hak- 
stain (1971), Hale (1983), Hannah (1946), Hoon (1974), 
Kulhavy. Dyer, & Silver (1975), Mathew:j (1938), McKune 
(1958), Noall (1962), Okey (i979), Orlando (1979, 1980a), Or- 
lando & Hayward (1978), Rickards & Friedman (1978), Santa, 
Abrams. & Santa (1979), Schultz & DiVest:i (19":'2), Shimmerlik 
& Nolan (1976), and Todd & Kessler (1971). 

Student Variables 

As indicated earlier, many student variables arc evident 
in this literature. Two arc specifically analyzed here: reading 
ability and prior knowledge*. Our analysis sliows that teaching 
noteraking to students below a certain level of a'^iding abilit) is 
not recommended. This conclusion is evident in the research 
tbat has identified differences in performance due to students* 
reading ability (Fox & Siedow, 1985; McKunc, 1958; Santa, 
Abrams, & Santa, 1979; Shimmerlik & Nolan, 1976; Todd & 
Kessler, 1971 J. It «ecms that students must be able to recognize 
important information in ihe material before notetaking can 
help. Otherwise, they will tend to take verbatim notes of irrele- 
vant concepts. As with under! -ling, notetaking cannot over- 
come lack of ability to find the main idea. 

No definite conclusions can be drawn regarding the role 
of students' background knowledge in their use of notetaking as 
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a study strategy. In only eight of the studies (Arnold, 1942; 
Brctzing & Kulhavy. 1979, 1981; Caverly, 1982; Davis & Annis, 
1976; Dyer, Riley, & Yeakovich, 1979; Okey, 1979; Orlando, 
1980a) was any consideration of students* background knowl- 
edge even reported. In five of the eight studies, background 
knowledge was controlled by pretesting for it and then either 
using it as a covariate, removing students who possessed it from 
the study, or selecting material on which the students were 
likely to have background knowledge. 

Initial evidence from the three studies that manipulated 
background knowledge (Bretzing & Kulhavy, 19Si; Caverly, 
1982; Davis & Annis, 1976) suggests that if students engage 
their background knowledge, they are better able to recognize 
an implicit structure present in the material and to use that 
structure to organize their notes. On the other hand, if the 
structure is explicit in the material, students are less likely to 
impose their own structure when taking notes and will use the 
author's structure instead. When an explicit structure is present, 
students tend to use this shallower level of processing, causing a 
concomitant reduction in performance. This result seems to in- 
dicate an interaction between t* student and material varia- 
bles. With only three studies pointing to this interaction, no 
valid conclusions can be drawn. However, this trend is sup- 
ported by the intent theoretical perspective and should be con- 
sidered in both instruction and in future research. 

In summary, two conclusions can be drawn about the ef- 
fect of subject variables on notetaking: 

1. Teaching notetaking from textbooks to students who 
are unable to recognize main ideas is inappropriate. 

2. The effect of engaging background knowledge is un- 
clear because of the small number of studies that 
have addressed this issue. If background knowledge 
is engaged before or during reading, notetaking may 
facilitate recall, either by directing students' attention 
to the structure of the material if their knowledge is 
weak or by causing students to impose their own 
structure onto the material in lieu of the author's. 
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Material Variables 

The studies under review manipulated many material 
variables. The four most important of these are content, read- 
ability, length, and explicit structure. Researchers have not used 
any particular content area when analyzing the effectiveness of 
notetaking. Our analysis found that notetaking was used in six 
different content areas, with a large majority in the social sci- 
ences. This choice of material by experimenters seems well 
founded. As noted earlier, social sciences seem to make up the 
bulk of the reading load in college (Caverly & Orlando, 1985). 

A second material variable is readability level. 
Schumacher (1987) hypothesized that material's level of diffi- 
culty can affect notetaking by affecting students' ability to iden- 
tify the main idea for subsequent encoding. If the material is 
exceptionally difficult, students will have trouble recognizing 
the ideas important enough for notetaking. This iS particularly 
tme for poor readers, indicating a student/material interaction. 
In the literature reviewed, only half of the studies reported the 
material's level of difficulty. Of those studies, only three 
(Caverly, 1982; Mathews, 1983; McKune, 1958) used college- 
level material; the other studies used material that was deemed 
**easy," Results from these studies do not allow us to draw con- 
clusions about the effectiveness of notetaking in real life study 
situations, in which the processing demands are o." , great. 
Most of these studies manipulated only one variable (usually the 
orienting task) and attempted lO control the other three varia- 
bles (student, material, and criterion task). Because of this em- 
pirical approach, it is difficult to draw any conclusions 
regarding the value of notetaking from college-level material. 

A third material variable is length. Schumacher (1987) 
hypothesized that if the material is longer, notetaking should 
help reduce the number of ideas needing retrieval. Research 
seems to support this view. In 13 of the 30 studies in our analy- 
sis, the material used was short (fewer than 1,000 words). The 
other 17 studies used longer material. Our analysis found that 
the 13 studies using shorter material had equivocal results w hen 
comparing performance after taking notes with performance 
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after using other study strategies. On the other hand, in all but 1 
of the 17 studies using longer material, perioAiiiance improved 
after notetaking. Only 1 study (Todd & Kessler, 1971) directly 
manipulated length of the material when examining the effect 
of notet:' ng. No differences were found in performance with 
different lengths of material, but the length of the passages 
ranged cnly from 44 words to 256 words. Because the material 
was so short, caution must be used when drawing conclusions. 

From our overall analysis, it seems that length of mate- 
rial is a factor in the effectiveness of notetaking as a study strat- 
egy. This conclusion mi be qualified, however, because in 
many of these studies, the effect of length on performance was 
obscured by other variables— for instance, the use of easy mate- 
rial. It seems that notetaking may not be a beneficial study strat- 
egy to recommend when students are faced with short material. 
The effort required by notetaking may be unnecessary with this 
material, given its liglit processing demands. When faced with 
longer material, however, students might select notetaking as a 
viable strategy. The impact of the materials length on the effec- 
tiveness of notetaking should be explored further. 

A final factor that may influence the effectiveness of 
notetaking is the explicit structure of the text. Several theorists 
(Baker & Brown, 1984; Breuker, 1984; Jonassen, 1985; 
McConkie, 1977) have hypothesized that if the structure of the 
passage is explicit, students v. ill use it to identify main ideas and 
to create verbatim notes at a shallow level of processing. If the 
structure is implicit, students are forced to parse out the struc- 
ture, thus processing the material at a deeper level ar^d presum- 
ably enhancing performance. Our analysis identified only 6 
studies out of 3 1 that reported the structure of the material, and 
only 2 of these actually manipulated structure during the study 
(Shimmerlik & Nolan, 1976; Schultz & DiVesta, 1972). The 
trend in these 2 studies was that when the text did not have an 
explicit structure, better students imposed their own organiza- 
tion. This imposed structure resulted in improved performance, 
particularly when the criterion task required recognition or re- 
call of high structural ideas (this indicating a student/material/ 
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criterion task interaction). The hypothesis regarding the effect 
of implicit structure can be tentatively supported, but this three- 
way interaction should be examined further. 

In summary, we can draw the following conclusions 
about the effect of material variables on notetaking: 

1. Notetaking should improve performance in any con- 
tent area, although it has been explored primarily in 
the social sciences. 

2. Notetaking is productive for **easy" material, but not 
enough data are available to recommend it for col- 
lege-level material (particularly for poor readers). 

3. Notetaking is more productive with longer material. 
This may be a product of students' decisions not to 
use the strategy with shorter material. 

4. Notetaking tends to be verbatim when the material 
has an explicit structure; when the structure of the 
material is implicit, notetaking tends to help students 
(particularly better readers) impose a structure. 



Orienting Task Variables 

Several distinct orienting task variables have also been 
identified in this review. First, if notetaking is to be effective in 
most situations, we must teach students to rtview their notes 
(Annis, 1976; Annis & Davis, 1978; Bretzing & Kulhavy, 1979; 
Davis &Annis, 1976; Dyer, Riley, & Yenkovich, 1979; Orlando, 
1979; Santa, Abrams, & Santa, 1979). The encoding effect of 
notetaking seems to hold up for immediate recall whether stu- 
dents review or not, however, only through review will stu- 
dents realize a benefit for any type of delayed test. In those 
studies that manipulated the review variable, significant im- 
provement in delayed recall was found only if students re- 
viewed their notes before the test. Indeec' some evidence in 
this literature . uggests an orienting task/criterion task interac- 
tion, with students taking fewer n^^Mes when expecting an im- 
mediate test and more notes when expecting a delayed tes^ 
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A second variable that arises is the apparent need to 
teach students how to take notes. Most students in these studies 
werc told or induced to use notetaking without being taught 
how to take notes. In only three studies (Arnold, 1942; Hannah, 
1946; Okey, 1979) were students actually taught how to take 
notes. Students in all of these studies showed improvement in 
comprehension after notetaking. In three other studies (Annis & 
Davis, 197P; Brown & Smiley, 1977; Davis & Annis, 1976), stu- 
dents were allowed to use any study strategy they preferred. 
Those students who spontaneously used notetaking showed 
better performance than those who opted for other study strat- 
egies. If notetaking is taught properly, it might become the strat- 
egy of choice for students faced with a study task. 

Our review suggests that this instruction needs to in- 
volve several features. First, students should be taught to uke 
notes on the superordinate structure rather than on the subordi- 
nate details. Second, students need to be aware of how notetak- 
ing can direct them to process the information on a deeper 
level, thus improving their recall. Third, students need to un- 
derstand that what matters is not the quantity but the quality of 
notes they take (Hakstain, 1971; Orlando & Hay ward, 1978). 
Finally, instruction should include teaching students how to 
recognize the main idea of each paragraph and how to relate 
each main idea to the underlying structure of the passage 
(Bretzing & Kulhavy, 1979, 1981; Fox & Siedow, 1985; 
Kulhavy, Dyer, & Silver, 1975; Orlando, i980a; Rickards & 
Friedman, 1978; Santa, Abrams, & Santa, 1979; Shimmeriik & 
Nolan, 1976). 

A third onentacing task variable analyzed was the role of 
criterion task knowledge, or whether students' knowledge of 
the criterion task ciused them to adjust their processing during 
encoding. Several theorists (Anderson, 1980; Baker & Brown, 
1984; Cook & Mayer, 1983; Gibbs, Morgan, & Taylor, 1982; 
Levin, 1986; Weinstein & Mayer, 1985) have concluded that this 
variable is an important factor in the success of notetaking as a 
study strategy. Researchers in only half the studies under review 
told students that they were going to be tested after studying or 
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gave them an idea of what the test would cover In only three 
studies— two by Hakstain (197 1) and one by Kulhavy, Dyer, and 
Silver (1975)— \ ^5 knowledge of the type of test to be manipu- 
lated. In these three studies, specific knowledge of the test con- 
tent did not benefit students. In the other studies, it is difficult 
to determine whether students adjusted their processing to fit 
their knowledge of what the test would cover or whether they 
adjusted their processing because they knew they were going to 
have a test (Anderson & Armbruster, 1982). 

On the surface, our analysis seems to suggest that crite- 
rion task knowledge is not a cogent factor in the effectiveness 
of notetaking, contrary to the conclusions reached by other re- 
searchers. However, if the student/orienting task/criterion task 
interaction is explored, support for the encoding specificity 
principle is found. Presumably, in any empirical environment, 
most college students would expect to be tested in the orienting 
task whether or not the researcher told them they would be. 
Some of these students woulc hoose to adjust their processing 
accordingly. When asked only to read or reread material, they 
would mentally rehearse the informatiotl, counter to the orient- 
ing task instructions given before reading. These students 
would be intentionally encoding information to match what 
they perceive the criterion task to bc; therefore, the encoding 
specificity principle would be activated whether or not it was 
part of the orienting task. Other students would follow the ori- 
enting task directions religiously to satisfy their perception of 
the criterion task. In either situation, if the actual criterion task 
reflects either the students' perceptions of the criterion task or 
the specific orienting t.^k requested of the students, notetaking 
will probably improve performance When the criterion task 
measures knowledge other than what was encoded, perform- 
ance probably will diop. 

A question arises as to whether performance is linked to 
criterion task knowledge and the consequent adjustment in 
processing, or whether it results from the criterion task fortui- 
tously matching the information that was encoded. This may 
be a '^chicken or egg" type of argument. Bern correct knowl- 
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edge of the criterion task and appropriate pi-ocessing strategies 
are necessary for successftil performance following notetaklng 
(Kulhavy, Dyer, & Silver, 1975). Therefore, previous analyses 
were correct when the importance of the encoding specificity 
principle was noted. We suggest that the larger interaction be- 
tween the student, the orienting task, and the criterion task 
must also be considered when determining the effectiveness of 
a study strategy like notetaking. 

In summary, three conclusions can be drawn about the 
effect of the orienting task variables on noteiakinjj: 

1. Review is necessary fo/ notetaking to be beneficial in 
delayed recall tasks. 

2. Instruction in notetaking is necessary for those who 
have not spontaneously developed the strategy (gen- 
erally average and poor readers). 

3. Notetaking is effective if students have knowledge of 
the criterion task and adjust their processing to fit 
this task. 

Criterion Task Variables 

The role of the previous three variables in notetaking be- 
comes particularly evident when we examine the criterion task 
variable. A surface analysis suggests that notetaking is equally 
Cifectivc on recognition and recall types of tests. This test type 
variable was manipulated in only three studies— two by Hak- 
stain (1971) and one by Kulhavy, Dyer, and Silver (1975). In the 
Hakstain studies, performance did not differ significantly be- 
tween students who received a recognition test and those who 
received a recall test, even though they were oriented toward 
expecting a certain type of test. On the other hand, in the 
Kulhavy et al. study, performance did differ depending on the 
type of test students expected to receive. This seemingly con- 
tradictory result might be explained by the encoding specificity 
principle discussed above, as well as by the fact that the test 
happened to match students' encoding behavior. Knowledge 
that a test will be given and knowledge of the type of test are 
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not the important variables. What seems to be important in ex- 
plaining the effectiveness of notetaking is the combined effect 
of these two variables and the students' ability to adjust pro- 
cessing at the time of encoding and/or retrieval. 

Similarly, whether the test was administered immedi- 
ately or after a delay is not an important variable on its own. 
What seems to influence the effectiveness of notetaking is the 
interactive effect of the time of the test with either a conscious 
choice or an induced decision to review, Notetaking seems to 
/mpm'/e immediate recall with or without review. However, de- 
layed recall was generally noi enhanced unless students re- 
viewed their notes before the test. In the two studies in which 
performance improved on the delayed test without review 
(Dyer, Riley, & Yenkovich, 1979; Fox & Siedow, 1985), other 
variables may have intervened. For example, in the Fox and 
Siedow study, the material was shorter than 200 words. In the 
Dyer et al, study, the material was deemed very easy. There may 
not have been a need to review such short or simple informa- 
tion. 

In summary, these conclusions can be drawn about the 
effect of the criterion task variables on notetaking: 

1, Students should be taught to identify the type of test 
they will be required to take and then adjust their 
notetaking accOA'dingly, 

2, If the test is to be delayed beyond immediate recall, 
review is necessary, 

Summc'i'y 

We can conclude from this research that notetaking 
while studyinga textbook helps students improve performance. 
Given an appropriate orienting task, students can produce a set 
of notes after engaging in deeper encoding processes. Then, if a 
delayed criterion task requires recall, they can review those 
notes to help them boost performance. However, studenis gen- 
erally must be taught how to take notes that are appropriate to 
the demands being placed on them. 
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Complex Organizational Strategies; 
Outlining and Mapping 

A third major group of study strategies categorized by 
Weinstein and Mayer (1985) are complex organizational strate- 
gies. Here, students are directed to recognize and summarize 
the organization of the material in a structured way order to 
facilitate encoding and recall. Perhaps the most common of 
these strategics is outlining, in which students reconstruct the 
explicit or implicit structure of concepts presented by the au- 
thor. Students are taught to use formal outlining notation to list 
the main ideas and supporting details, as well as the superordi- 
nate and subordinate connections between these ideas. 

More recently, a type of outline strategy known as map- 
ping (and its many variations, which include the Construct pro- 
cedure, networking, Node Acquisition Integration Technique, 
and schematizing) has been promoted as a replacement for the 
older style of outlining. This group of study strategies directs 
students to construct a diagram, or spatial image, of the text's 
structure, using nodes to represent the main ideas and support- 
ing details, •?nd links to represent the relationships between the 
ideas in the text. In the mapping type of study strategy (liereaf- 
ter simply called mapping), students are often taught to label 
the connections using common pattern structures, such as 
problem-solution, cause-effect, and time-order (Armbruster, 
1979; Slater, Graves, & Piche, 1985) 

Outlining emerged from the product theoretical per- 
spective of the studying process. Mapping is based on the proc- 
ess and intent perspectives. Mapping differs from outlining in 
that it encourages students to match their background knowl- 
edge to the text and to generate spatial images lepresenting this 
interaction. Neither of these study strategies has a robust re- 
search heritage, wc found only 10 studies examining the use of 
outlining among a college-level population and only 1 1 studies 
examining the use of mapping. To improve our integrative anal- 
ysis of this group of study strategies, we combined the literature 
on outlining and mapping as we reviewed the variables of the 
teirahedral model. 
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Several previous reviewers who have analyzed the litera- 
ture on outlining and mapping strategics have identified interac- 
tions among the variables of the tetrahedral model. Dansereau 
et al. (1974) found a student/orienting task/criterion task inter- 
action in the outlining research. They found several factors that 
influenced students' choice and use of a particular strategy to fit 
their study environment. These student factors included intel- 
lectual ability, personality, cognitive style, learning style, moti- 
vation, gender, and prior knowledge of the content. From this 
review, Dansercau (1978) fashioned his notion of the interac- 
tion between primary strategies (general and specific textbook 
study strategies) and secondary strategies (the students' state- 
ment of goals, concentration management, and monitoring of 
progress toward their goals). Dansereau (1980) also reported a 
student/orienting task interaction in his review of the research 
on networking (his version of mapping). He found a need for 
instruction in the study strategy, as well :is greater success fol- 
lowing instruction among students of middlc-kvel reading 
ability. 

Anderson and Armbruster (1980, 1982, 19S4) found an 
orienting task/criterion task interaction for the outlining study 
strategy They concluded that in those studies in which outlin- 
ing was not taught, it ineffective with certain types of crite- 
rion tasks. When the students were induced to use the outlining 
strategy, they processed information on a shallow level. 
Anderson and Armbruster argued that this finding may have 
oeen the resuK of the cxpvriments' design. In attempting to 
control for the time-on-task of different study strategy treat- 
ments, the researchers may actually have made shallow proc- 
essing inevitable, because outlining is a time-consuming 
activity, students may have been forced to process the informa- 
tion on a shallow level to finish in the allotted time. They con- 
cluded that outlining should be a more effCLtive stud) strateg) 
than the literature has shown. It could foster deeper processing 
if the orienting task provides enough time for instruction and if 
the criterion task allows time for deeper processing. 

Dansereau and Holley (1981), in reviewing the network- 
ing re.v:arch, confirmed the student/orienting task interaction 
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that Dansercau (1980) found earlier. Mapping strategics were 
more effective for students with low grade point averages (GPAs) 
if support strategies were taught along with the primar>' strat- 
egy. They found a two-way interaction between the material 
and the criterion task variables of the tetrahednil model. The 
mapping strategy was more effective in longer material if 
links on the map were labeled, and labeling links in longer ma- 
terial was more effective if the criterion task measured recall of 
main ideas rather than of details. They acknowledge, however, 
that these interactions are based on relatively sparse research. 

Two reviews were completed on another type of 
mapping called schematizing (Camstra & van Bruggen, 1984; 
Elshout-Mohr, 1983). These reviewers identified a siudent/ma- 
terial/orienting task viteraction. Schematizing helped students 
with low verbal ability improve their performance with mate- 
rial that was explicitly structured, but it hindered them with 
material that was implicitl) structured. After instruction in 
schematizing, low-ability students were able to use schematiz- 
ing successfully in implicitly structured material as well. This 
finding confirmed that instruction was necessary for success to 
be demonstrated with a particular type of textbook. 

McKeachie's (1984) review of the outlining and mapping 
research confirmed the student/orienting task interaction. In 
the studies he reviewed, medical students needed only 4 hours 
of instruction, adolescents needed up to 20 hours, and college 
students with low verbal ability needed 22 houi^. McKeachie 
also identified a student/criterion task interaction. On recall 
types of tasks, or recall of main ideas, no differences in per- 
formance emerged between students with lower opas and those 
with higher GPAs. However, on recognition types of tasks, or 
tasks that measure mostly details, students with lower opas per- 
formed better. McKeachie also corroborated a student/material 
interaction, finding that students with low reading ability 
needed more structure in the text than did students with high 
reading ability Also, mapping study strategies were not as bene- 
ficial to students with strong background knowledge about the 
content as they we; c to students with weak background knowl- 
edge, particularly it the material was poorly structured. 



Caverly and Orlando 



HoUey and Dansercau (1984) reviewed the outlining and 
niapping literature and identified a material/criterion task inter- 
action. Use of mapping with narrative material facilitated de- 
layed recall but not immediate recall. 

Our review of the empirical literature, using the variables 
of the tetrahedral model, fiiirthers these analyses of outlining 
and mapping study strategies. In our integrative review, we 
found 21 studies of these strategies with college-age students 
presented in 20 reports: Arkes, Schumacher, & Gardner (1976), 
Arnold (1942), Castaneda, Lopez, & Romero (1987), Dansereau 
et al, (1979a, 1983), Diekhoff, Brown, & Dansereau (1982), 
Good (1926), Holley et al, (1979), Long (1977), Long & 
Aldersley (1982), Mathews (1938), McClusky & Dolch (1924), 
McKune (1958), Salisbury (1935), Pugh-Smith (1985), Smith & 
Standahl (1981), Snyder (1984), Stordahl & Christensen (1956). 
Vaughn, Stillman, & Sabers (1978), and Willmorc (1966), Sev- 
eral other studies examined outlining or mapping with younger 
populations, but we chose not to include these studies in this 
review. 



Student Variables 

From our review of the OMtlining and mapping literature, 
we found a strong student/orienting task interaction. Among 
those studies that reported students' reading ability and taught 
the study strategy, subjects in all except two (Arnuld, 1942; 
Willmore, 1966) demonstrated increased performance follon- 
ing outlining or mapping (Holley et al,, 1979; Long & Aldersley, 
1982; Salisbury, 1935; Pugh-Smith, 1985; Snyder, 1984; 
Vaughn, Stillman, & Sabers, 1978), Initially, one might assume 
that this finding was an artifact of instruction and not of the 
interaction between instruction and reading ability. However, 
when we examined those experiments that did not teach the 
study strategy, only the high-ability students showed improved 
performance (Arkes, Schumacher, & Gardner. *976, Castaneda, 
Lopez, & Romero, 1987; Good, 1926), So it <iems that simply 
advising students to use outlining or mapping is not warranted 
unless thej' are able readers; instruction must be provided, par- 
ticularly for the poor readers, 
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Another finding was that backgrouPAl knowledge may 
affect a four-way student/material/orienting task/criterion task 
interaction, though only eight of the experiments reported ex- 
amining students' background knowledge. Six of those studies 
removed the effect of background knowledge from the cxperi- 
ment by controlling it or matching students in the design 
(Castnneda, Lopez, & Romero, 1987; Dansereau et ah, 1983; 
Diekhoff, Brown, & Dansereau, 1982; Stordahl & Christensen, 
1936; Vaughn, Stillnian, & Sabers, 1978; Willmore, 1966). Two 
other studies used material in which the studentb demonstrated 
either strong or weak background knowledge (Arnold, 1942; 
Pugh-Smith, 1985). Arnold found no consistent effect forsupe- 
rior background knowledge, although students who used an 
outlining study stnitegy tended to h:\\L' the poorest perform- 
ance of students using various study strategies. 

Pugh-Smith (1985) argued that superior students with 
wen.k background knowledge are often forced by the criterion 
task to geneiate a product and to depend on what she calls 
'^bootstrapping" techniques. She s*3ggested that these tech- 
niq. es, which include mapping, annotating, and summarizing, 
implicitly limit students to the textbook as the only source of 
information, and that if the students selected several sources to 
build background knowlec^.. and understanding (a process she 
calls '^scaffolding"), comprehension of difficult texts might be 
improved. 

Pugh-Smith (1985) observed that the students in her eth- 
nographic experiment did not attempt this btrateg) even though 
they had 3 weeks to complete the rask. They depended only on 
bootstrapping strategies and used no sources other than the test 
material in an attempt to understand. These strategies did not 
.seem to help the students understand difficuh text. Pugh-Smith 
argued that students chose these strategies because they per- 
ceived their Lisk a*^ gencniting a product for someone else, not 
;is developing understanding for their own satisfaction. She fur- 
ther argued that this lack of ''ownership" on the part of the 
students and the subsequent reliance on bootstrapping tech- 
niquc5 occurs when the material and the criterion task are de- 
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tcrmined by external agents. Giving ownership of the study 
situation to the students, she contended, would affect their 
choice of study strategy and their c\'entual comprehension. 

These interactions documented by Pugh-Smith seem to 
substantiate the intent perspective. If these interactions can be 
verified in other rerearch, it will be clear that how students are 
tauglit to perceive the criterion task and its ownership will de- 
termine the study strategy they select. 

In summary, these conclusions can be drawn about the 
effect of the student variables on outlining and mapping: 

1. Students with low rca^ ng ability need instruction to 
use outlining or mapping effectively. 

2. Evidence from our ^c^iew confirms the arguments of 
previous rc\'iews that students select a strategy to fit 
xheir perceptions of the criterion task. 

3. Initial evidence suggests that ownership of the stu- 
dent/orienting task/material/criterion task interaction 
might affect which study strategy a student selects, 
particularly if the student has little background 
knowledge about the material. 

Material Variables 

The effects of material variables on mapjMng are not as 
easily identified in the iX'search reviewed. In terms of content, 
the majority of the 40 pieces of text used in the studies wea' 
from the social sciences. This is consistent with the findings a*- 
ported for underlining and nofftaking. Still, no experiment ma- 
nipulated the content variable to measure its effect on outlining 
or mapping. 

For those nine studies that reported the readability of the 
material, all but one (Castaneda, Lopez, & Romero, 1987) se- 
lected material deemed at or above reading level of the stu- 
dents. Implicit in this research is a student/material interaction. 
Unlike underlining or noteuking, it is assumed that outlining 
and mapping are strategies intended for use Wiih material 
deemed more difficult for students. 
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In terms of the length of the material, there seems to be a 
material/orienting task interaction. When shorter nmerial 
(fewer than 1,000 words) was used, instruction did not seem as 
necessary as when longer material (more than 1,000 words) 
was used. With shorter material, the research is equivocal. Two 
studies (Long &Aldersley, 1982; Smith &Standahl, 1981) found 
a significant improvement with shorter material following in- 
struction in and ust of outlining or mapping. Three studies 
(Arkes, Schumacher, & Gardner, 1976; Castaneda, Lopez, & 
Romeio, 1987, Good, 1926) demonstrated improvement when 
using shorter material without instruction. When using longer 
material, on the other hand, six studies demonstrated improve- 
ment following instruction in oudining or mapping (Dansereau 
et al., 1979a, 1983; Diekhoff, Brown, & Dansereau, 1982; 
HoUey et al., 1979; Snyder, 1981; Vaughn, Stillman, & Sabers, 
1978), while only two demonstrated improvement without in- 
struction (Mathews, 1938; Pugh-Smith, 1985). 

The structure of the material seems to be basic to the 
e\aluation of the effectiveness of outlining and mapping study 
strategies. The structure is what these strategies emphasize, and 
its reproduction is often the criterion task. Previous research 
had identified a student/material/orienting task interaction, stu- 
dents w ith low reading ability performed better if the material 
was explicitly structured and if they were taught how to outline 
or map. 

Our review found only five experiments that reported 
identifying or manipulating the structure of the material 
(Castaneda, Lopez, & Rom^^ro, 1987; Good, 1926; Long, 1977; 
Long & Aldersley, 1982; McClusky & Dolch, 1924). In three of 
these studies, the structure of the material was manipulated, 
ranging from explicit to implicit. McClusky and Dolch pro\ided 
one passage and vaned the cxplicitness of the structure from 
using no signal words (implicit structure), to providing transi- 
tions (vague structure), to numbering the sentences (explicit 
structure). Good used the same passage that McClusky and 
Dolch did and manipulated the complexity of the structure by 
obscuring or not obscuring the main idea with explanatory sup- 
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porting ideas. Castaneda et al. made the structure more implicit 
by selecting three passages of increasing length as well as in- 
creasing lexical and syntactic difficulty Although the sample of 
research is fairly small, these five studies co;ifirm the student/ 
material/orienting task interaction. Students with low reading 
ability were not able to recognize implicit or embedded struc- 
ture without instruction. 

In summary, we can draw the following conclusions 
about the effect of material variables on OMdining and mapping. 

1. Since none of the research manipulated content, the 
influence of this variable on the effectiveness of out- 
lining and mapping cannot be determined. 

2. Oudining and mapping were generally more success- 
ful with material that was deemed at or above the 
reading level of the student. 

3. The effectiveness of outlining and mapping is more 
dependent on instruction with longer material than it 
is with shorter material. 

4. With implicitly structured material, outlining and 
mapping are effective study strategies for students 
with low reading ability only if ihey receive instruc- 
tion. 

Orienting Tasic Variables 

Some potential effects of orienting task variables can be 
identified in the outlining and mapping literature. We found a 
possible material/orienting task/criterion task interaction in that 
reviewing the outline or map made a difference, particularly in 
studies that used longer material and that required students to 
produce verbatim recall. This conclusion must be tempered, 
however, as only three studies reported allowing for review be- 
fore the criterion task (Castaneda, Lopez, & Romero, 1987; 
Pugh-Smith, 1985; Willmore, 1966). In the Castaneda et al. 
study in which review was manipulated, the researchers found 
that verbatim recall of shorter material was significantly hin- 
dered following the use of mapping without review. 

O 
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The ellfect of teaching on outlining and mapping is^much 
more obvious. In 13 studies, either outlining or mapping was 
taught to students, with instruction ranging irom 1 hour to 30 
hours (Arnold, 1942; Dansereau et al., 1983, 1979a; Diekhoff, 
Brown, & Dansereau, 1982; Hoiiey et al., 1979; Long, 1977; 
Long & Aid rsley, 1982; Salisbury, 1935; Smith & Standahl, 
1981; Snyder, 1984; Stordahl & Christensen, 1956; Vaughn, 
-iUman & Sabers, 1978; WilLmore, 1966). Students in only 4 of 
these studies demonstrated no improvement in recall after in- 
struction (Arnold; Smil' & Standahl; Stordahl & Christensen; 
Willmore), indicating a material/orienting task interaction, since 
3 of these studies did not allow for review prior to the criterion 
task. In addition, as noted earlier, a student/material/orienting 
task interaction exists; students with lower reading ability who 
were given instruction performed better than those not given 
instruction, particularly with longer or implicitly structured 
material. 

The effect of criterion task knowledge is less obvious in 
this literature. In 12 of the studies, criterion task knowledge was 
directly or indirectly influenced. In some the students were told 
what to expect on the test (two experiments in Arkes, 
Schumacher, & Gardner, 1976); in some they performed the 
study strategy while completing the test (Good, 1926; 
McClusky & Dolch, 1924; Pugh-Smith, 1985); and in others 
they took several practice tests similar to the criterion test be- 
fore the experiment (Arnold, 1942; Dansereau et al., 1983, Hoi- 
iey et al., 1979; Long, 1977; Stordahl & Christensen, 1956; 
Willmore, 1966). In 5 of these studies, knowledge of test de- 
mands did not help improve performance following oudining 
or mapping. A closer examination of these studies reveals that 
this lack of improvement might have been caused by the stu- 
dents' inability to review prior to the criterion task (Ainold, 
Long; McClusky & Dolch; Stordahl & Christensen), or by low 
reading ability among the students (Arnold; Long, Stordahl & 
Christensen; Willmorc). Conversely, the improved performance 
demonstrated in the other studies ma) be attributed to variation 
in the ability of the students (Arkes et al.; Good; HoUey et al.; 
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Pugh-Smith) or to the amount of instruction they received 
(Dansereau et al., 1983, 1979a; Holley et al.). Within our re- 
view, a student/orienting task interaction seems to be masking 
the variable of critedon task knowledge. 

In sutnmary, we can draw three conclusions about the 
effect of orienting task variables on outlining and mapping: 

1 . Review before a verbatim recall criterion task tends to 
he necessary for successful performance. 

2. The effectiveness of outlining and mapping is depen- 
dent on instruction, particularly for poore. *eaders. 

3. Criterion task knowledge seems to be embedded in a 
student/orienting task interaction in which students' 
ability and opportunity for review must also be con- 
sidered. 

Criterion Task Variables 

Test type had a distinct influence on the effectiveness of 
outlining and mapping. Eighteen studies used experimenter- 
designed recognition and/or recall tests after students studied a 
text passage. Three other studies used either standardized tests 
that did not allow mapping or outlining to be used (Salisbury, 
1935; Smith & Standahl, 1981) or ethnographic measures that 
observed spontaneous use of mapping or outlining (Pagh- 
Smith, 1985). Improved performance was not demonstrated on 
any recognition-type tests following outlining or mapping 
(Arnold, 1942; Dansereau et al., 1983, 1979a; Long, 1977; 
Mathews, 1938; McKune, 1958; Snyder, 1984; Stordahl & 
CKristensen, 1956; Willmore, 1966). Improved performance 
was found on recall measures in seven of the nine studies that 
used these measures. ^ 

It seems that recognition criterion tasks were not sensi- 
tive enough to measure the benefits of outlining and mapping. 
This may be due to the nature of the outlining and mapping 
task, which directs students to attend to main ideas and the rela- 
tionships among them, while de-emphasizing details. It is diffi- 
cult to tell what ratio of main ideas to details was present on 
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these re'jognition tests. Students using an outlining or mapping 
Strategy are less likely to demonstrate improved performance 
on a crittiic^n task that focuses on detail than on a criterion task 
that focuses on main ideas. This conclusion is consistent with 
those of previous rcview^ (Anderson, 1978; Kolley & Danse- 
reau, 1984; McKeachie, 1988). 

When considering the delay between using outlining or 
mapping and taking the test, no clear pattern emerged. How- 
ever, when the orienting task/criterion task interaction is exam- 
ined, a strong effect emerges. In the seven studies in which 
students showed no improvement on an immediate test 
(Arnold, 1942; Long, 1977; Mathews, 1938; McClusky & 
Dolch, 1924; McKune, 1958; Stordahl & Christensen. 1956; 
Willmore, 1966), review was not allowed before the test. In the 
six studies (all but t* e McClusky & Dolch study) in whicn stu- 
dents showed no improvement on a delayed test, again review 
was not allowed before the test. It seems that review is a critical 
variable in the success of outlining or mapping over both the 
short and the long run. 

In summary, these conclusions about the effect of the 
criterion task variables on outlining or mapping ran be drawn: 

1. Outlining and mapping seem to improve students* 
performance when the criterion task focuses more 
on main ideas than on details; thus, they seem *o fa- 
vor tne encoding and recall of main ideas ovi. the 
encoding and recall of details. 

2. Review seems to be important for outlining and :nap- 
j^ing to improve performance on either immediate or 
delayed tests. 

Summary 

Based on this review, we conclude that students must be 
taught how to use the outlining and mapping study strategies. 
This is particularly true for students with low reading ability 
and students working with longer material (more than 1,000 
words). There is some evidence that students must be taught 
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not only how to use these study strategies but also how to as- 
sess the interaction between their purpose for reading (i.e., 
their knowledge of the criterion task) and how well their back- 
ground knowledge matches the material. If students can assess 
their abilities, the text, and the context, outlining and mapping 
seem to be effective strategies for improving the recall of main 
ideas, although not necessarily of details. 

Ccmprehension Monitoring Strategy: 
SQ3R 

A fourth group of study strategies posited by Weinstein 
and Mayer (1985) are comprehension monitoring strategics. 
Study strategies within this group are often labeled metacogni- 
tive strategies. They direct students to establish goals for the 
study situation, to assess progress toward these goals, and to 
modify processing if progress is unsatisfactory. (The theoretical 
foundation for metacognitive strategies is discussed in Chapter 
2, this volume.) 

One common study strategy that leads students to moni- 
tor their comprehension if SQ3R, developed by Robinson 
(1946, 1961, 1970). This strategy directs the studems to com- 
plete activities before reading (Survey the material by rkimming 
it for organizing information and formulate Questions or goals 
by converting th'^ ^subheadings mto questions), during reading 
(Read to answer the questions, monitor progress in answering 
the questions, and modify processing if progress is unsatisfac- 
tory), and after reading (Recite the answers to the questions and 
Review the answers). Of all the independent strategies available 
to the college reading teacher, sq3R and its variations (Stahl, 
1983) are perhaps the most often taught. Nevertheless, anyone 
with a passing exposure to the literature realizes that such strate- 
gies also are the most maligned (Adams, Carnine, & Gerstcn, 
1982). 

Several researchers have reviewed the theoretical and/or 
empirical foundations used to support the use of so3u (Anderson 
& Armbruster, 1982; Crewe & Hultgren, 1969; Gustafson & 
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Pederson, 1985; Jacobowitz, 1988; Johns & McNamani, 1980; 
Kopfstein, 1982; Orlando, 1978, 1984; Pathbcrg, 1972; Spencer, 
1978; Stahl, 1983; Tadlock, 1978; Walker. 1982; Wark, 1965). 
The majority of these reviewers concluded that while some of 
the individual steps may have merit, little evidence validates the 
use of the entire system as designed by Robinson (1946). Further, 
these analyses found little or no empirical evidence to suggest 
that Sq3r is more ef/ective than reading or rereading. Finally, 
they concluded that nany intervening variables may help or hin- 
der SQ3r's effectivene>s. 

These researchers have found evidence to support the 
effect of two student variables and two orienting task variables 
on Sq3R*s effectiveness. For example, reviewers have concluded 
that thestudent*s level of cognitive development is a factor that 
must be considered (Niles, 1963; Orlando, 1984; Trillin & Asso- 
ciates, 1980). These reviewers argue that students must reach an 
advanced level of cognitive performance before they can un- 
derstand the Sq3r system. Bean, Smith, and Searfoss (1980) ex- 
plored another student variable, background knowledge, and 
found that it can interfere with the effectiveness of sq3r's ques- 
tion step. 

Several reviewers speculated that a major reason for the 
lacK of evidence supporting sq3r is that the orienting task varia- 
bles interfere. In their reviews, it was found that Sq3r often was 
poorly taught (Bahe, 1969; Basile, 1978; Entwistle, I960; Fox, 
1962; Orlando, 1978; Palmatier, 1971) or that success was Jue 
to time-on-task rather than on the processing inherent in the 
strategy's use (Alessi, Anderson, & Goetz, 1979). 

In addition to the effect of these individual variables, 
one two-way •♦iteraction and one three-way interaction were 
found. Anderson and Armbruster (1982) found a two-way inter- 
action between the orienting task and the criterion task varia- 
bles that may explain the inability of the experiments they 
reviewed to demonstrate sq3r*s effectiveness. They found that 
experimenters (following advice given by Robinson, 1946, 
1961, 1970) taught students to convert subheadings into ques- 
tions irrespective of the criterion task. The researchers argued 
that it is realistic to expect the students to have knowledge of 
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the criterion task and to use this knowledge to adjust their proc- 
essing. Instruction, therefore, should include matching process- 
ing to the criterion task. 

Anderson and Armbruster (1982) also believe there may 
be a three-way interaction between the material, the orienting 
task, and the criterion task variables. Instruction suggested by 
Robinson (1970), and used by most of the studies Anderson and 
Armbruster reviewed, presents the subheadings as reflecting the 
most important ideas of the mate ial. Moreover, this instruction 
assumes that instructors will base their tests on the subheadings 
of the material used. Armbruster and Anderson's (1984) review 
of textbooks found that most had inadequate subheadings that 
failed to communicate either the important information or how 
that information was organised. They conclude that this factor 
should be considered in teaching students to use SQ3r and in 
future research into the stufiy strategy 

To further these analyses of SQ3R, we will now look at 
the empirical literature. In our review, we were able to locate 25 
reports citing 26 studies that explored SQ3R specifically (rather 
than its many variations): Beneke & Harris (1972), Briggs, Tosi, 
& Morley (1971), Butler (1983), Courtney (1965), DeLong 
(1948), Diggs (1972), Doctor et al. (1970), Driskell & Kelly 
(1980), Eanet (1978), Galloway (1983), Gurrola (1974), Hannah 
(1946), Harris & P^am (1972). Heeiman (1972). Holmes (19"'2), 
Ktemer, Aeschleman. & Petersen (1983), Martin (1983), McRey- 
nolds & Church (1973). Niple (1968). Robinson (196I). Scap- 
paticci (1977). Snyder (1984), Stoodt & Balbo (1979), Willmore 
(1966), and Wooster (1953). Surprisingly, half of these reports 
were master^s or doctoral theses, suggesting a serious paucity in 
the published literature. Only 1 1 of the studies reported signifi- 
cant improvement following use of the sQ3R study strategy The 
in.ervening variables of the tetrahedral model ma) help explain 
this lack of positive effect. 



Student Variables 

From our review of these studies, we found that we 
could not separate the student variables from the orienting task 




tbook Study Strategics J[ 5 S 



143 



variables. Virtually every study taught sq3R; thus, their analyses 
may reflect the effect of in^trucrion on students rather than the 
effect of the study strategy itself. From our analysis of this stu- 
dent/orienting task interaction, we found that var>ung amounts 
of instructio:i were needed for students with different levels of 
reading ability. Students with low ability seemed to need inten- 
sive and lengthy instruction for improved performance (Beneke 
& Harris, 1972; Briggs, Tosi, & Morley, 1971; Butler, 1983; 
Diggs, 1972; Driskell & Kelly, 1980; Martin, 1983; Stoodt & 
Balbo, 1979). 

Only three studies (Galloway, 1983; Gurrola, 1974; 
Snyder, 1984) found no improvement among low-ability stu- 
dents after instruction. A closer examination of these three 
studies reveals th.'* the interaction between students' reiding 
ability and the length of instruction confounded the results, re- 
sulting in this lack of improvement. In these studies, students 
with low, medium, and high reading ability received less than 6 
hours of instruction in sq3r. Both a metaanalysis (Caverly, 
1985) and empirical research (Orlando, 1980b) suggest that at 
least 10 hours of instruction is necessary for SQ3r to be effec- 
tive ''or low-ability students. For medium-ability students, 7 to 
10 i*ours arc necessary, while for high-ability students, success 
has been demonstrated with less than 7 hours of instruction 
(Butler, 1983; Galloway, 1983; Gurrola, 1974; Martin, 1983). 

Generally, teaching sq3R was not sufficient to overcome 
students* lack of reading ability, although students at all levels 
seemed capable of learning how to use the strategy, given suffic- 
ient instruction. Moreover, there seems to be strong evidence in 
this literature that students* attitudes toward the amount of ef- 
fort needed for sq3R affect both whether they use the strategy 
beyond instruction and their subsequent improvement in per- 
formance (Butler, 1983; Briggs, Tosi, & Mi Icy, 1971; Courtney, 
1965; Doctor et al., 1970; Harris & l.cam, 1972; Kremer, 
Aeschleman, & Petersen, 1983; McReynolds & Church, 1973; 
Niple, 1968;Scappaticci, 1977; Wooster, 1953). 

No conclusions can be drawn regarding the effect of 
background knowledge on sv5R. Only two studies considered 
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this variable (Butler, 1983; Willmore, 1966), and both con- 
trolled it to remove any effect. 

In summary, these conclusions can be drawn about the 
effect of the student variables on SQ3R: 

1. Students must be taught how to use SQ3R. 

2. Students with low reading ability must be taught for a 
longer period of time than those with medium abil- 
ity, who, in turn, must be taught longer than those 
with high ability. 

3. The effect of students' background knowledge on 
SQ3r cannot be determined since it was not consid- 
ered in any of the research. 

Material Variables 

The material variables surrounding the use of SQ3R were 
not thoroughly examined in any of the research reviewed. A to- 
tal of 24 piects of text were used in these studies that examined 
SQ3R, most of which again were from the bocial sciences. Sev- 
eral other studies used the textbooks from students' currer' 
classes in an attempt to teach students how to transfer the SQ3R 
study strategy to iheir required reading material (Beneke & 
Harris, 1972; Briggs, Tosi, & Morley 1971; Doctor et al., 1970; 
Harris & Ream, 1972: Kremer, Aeschleman, & Petersen, 1983; 
McReynolds & Church, 1973; Robirison, 1961). A few studies 
did not report what type of material was used (Courtney 1965; 
DeLong, 1948; Eanet, 1978; Heerman, 1972). No conclusions 
can be drawn regarding the effectiveness of SQ3R in the differ- 
ent content areas college students study. 

Few conclusions can be drawn about the readability of 
the material used by researchers, since only four reported the 
difficulty level of the material used in their study (Holmes, 
1972; Martin, 1983; Snyder, 1984; Wooster, 1953). Three of 
these studies reported that material was written at the college 
level or higher. Several other studies, as just noted, attempted to 
have students transfer the sq3R strategy to their required read- 
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ing in their other classes. We can only assume these studies used 
college-level material. 

Not unexpectedly, the material used in the studies exam- 
ining SQ3r was considerably longer than the material found in 
the research on underlining or notetaking. This was probably 
because of the nature of the strategy, which requires material 
with an introduction, several subtitled sections, and a summarj\ 
Interestingly, the readability level of much of the material used 
in these studies was rather low for college-age students. Seem- 
ingly, the researchers conducting these studies were concerned 
with the effect of SQ3r and did not wish to confound this factor 
with passage difficulty. The only factor that might explain the 
lack of improved performance through sq3R is the material/ori- 
enting task interaction. 

Similarly, we can draw no conclusions based on the 
structure of the material, since virtually no experiment ex- 
plored the effect of text structure on the use of sq3r. This was a 
rather surprising finding, considering the extent of the literature 
on the effect of explicit structures on comprehension. Perhaps 
one explanation for this gap in the research is that the experi- 
menters assumed the five organizational components (introduc- 
tion, subheading, highlighted T'ords, graphics, and summarj') 
that students are induced to sur 'ey made up an explicit struc- 
ture. Given the product perspective that we believe is inherent 
in Robinson's (1970) directions for the study strategy, thiu as- 
sumption is not unexpected. Much of the inconsistent results of 
the research on the SQ3R study strategy might explained by 
the uncritical acceptarice of this assumption by students and 
instri'» tors. 

In summary, wt can draw the following conclusions 
about material variables on sq3R: 

1. Since research in this area is practice y nonexistent, 
little can be said about the effect of material variables 
on sq3r. 

2. Future research needs to manipulate the content vari- 
able to examine whether SQ3R is equally effective in 
different content areas. 
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3. The material used in the research analyzed was gen- 
erally at the college readability level, but only a few 
studies reported effects due to the material. 

4. The material was generally longer than that used in 
research on other study strategies this difference was 
probably due to the inlierent nature of SQ3R. 

5. No conclusion can be drav-n regarding the effect of 
the structure of the material on the SQ3R study 
strategy. 



Orienting Task Variables 

One distinct orienting task variable is the opportunity 
for students to review after study. One might expect review to 
be an important factor, given its effect on underlining and note- 
taking, and given that it is presumably inherent in the last two 
steps of the sq3R strategy (recite and review). Nevertheless, only 
four studies (Buder, 1983; Holmes, 1972; Willmore, 1966; 
Wooster, i953) provided an opportunity for students to rc/iew 
befct^ the criterion task, and the results were equivocal. With 
longer passages more likely to require the use of sq3r, this fail- 
ure to provide a review opportunity seems counter to the inten- 
tion of the recite and review steps. This material/orienting task 
interaction might have much to do with the failure of the re- 
search to demonstrate improved performance when students 
use SQ3r. 

A second orientrng task variable is the importance of 
teaching students the sq3r study strategy. As stated earlier, vir- 
tually every studi taught this strategy, with the length of in- 
struction ranging from 1 hour to 12 weeks. This instruction 
brought to light a distinct su:^iect/orienting task interaction in 
that students with lower reading ability needed more instruc- 
tion than those with higher reading ability. 

In summary, these conclusions about the effect of the 
orienting task variables on SQ3R can be drawn: 

1. The amount of instruction needed for SQ3R to be ef- 
fective is directly related to the student's level of 
reading ability. 
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2. Lack of research makes it impossible to draw conclu- 
sions about the effect of reviewing before the crite- 
'•ion task. 

Criterion Task Variables 

The criterion task variables seem to have a distinct but 
inconsistent effect on sq3R. In only 2 of the 13 experiments 
that used a recognition test as the criterion task was sq3r found 
to be effective (Butler, 1983; Martin, 1983). Similarly, the 2 
studies that used recall tasks (Gurrola, 1974; Stoodt & Balbo, 
1979) had equivocal results. £Q3r was found to be effective, 
however, in 3 of the 8 experiments that used the students' GPA 
as the criterion (Beneke & Harris, 1972; Briggs, Tosi, & Morley, 
1971; Driskell & Kelly, 1980; Harris & Re?m, 1972; Heerman, 
1972). This finding may suggest that recognition and recall 
tasks arc not sensitive enough to identify performance differ- 
ences with sq3R. However, conclusions baseu on GPA must be 
made carefully since so many other factors can influence 
grades. 

If we examine the interaction between the orienting task 
and the criterion task, we can see a :eason for these inconsistent 
peri jrmance findings. For example, the amount of instruction 
given to low-ability students was often insufficient. With only 
one exception (Holmes, 1972), in the experiments in which stu- 
dents demonstrated no improvement on recognition or recall 
types of criterion tasks, Icbs than 8 hours of instruction was pro- 
vided. Therefore, it is difficuU to drr^w conclusions about the 
effect of sq3R on reading performance jsing these criterion task 
variables. One interpretation is that sq3r does not affect read- 
ing comprchciision and retention diicctly, but affects it indi- 
rectly through improving students' attitudes toward study This 
improvement in students* attitudes about the . 'nount of effort 
necessary to study college-level m?.terial would then be mani 
fested in iniprovement in long term criterion measures such as 
GPA. F'Uure research is needed to verify this hypothesis. 

i.aother explanation for why sq3R affects performance 
on GPA but not on recognition or recall tests is that the longer 
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teem measure allows more ^«*ial applications for learning this 
stu Jy strategy. That is, success on GPA measures could be related 
to our second criterion task variable, test adminii^tration delu. 
A recognition or recall criterion task tends to measure* applica- 
tion of the study strategy after a single application. In most em- 
pirical studie s students apply SQ3R to a passage and then take a 
recognition or recall test either immedia':ely or several days 
later. If the criterion U^sk is semester GPA, owever, students 
have the opponunity to apply SQ3R several time^ in a variety of 
study situations before their performance is measured. It may 
be, then, that a positive performance effect for SQ3R, shows up 
only after stud( -..s have had a chance to apply the study strat- 
egy se/eral times. 

A test of this hypothesis is implicit in several experi* 
ments in which students who learned SQ3R demonstrated im- 
proved performance (as measured by Gpa) after one semester 
(Briggs, Tosi, & Morley 1971; Driskell & Kelly, 1989; Stoodt & 
Balbo, 1979; Wooster, 1953), after two semesters (Heerman, 
1972), and after thre-e semesters (Bcneke & Harris, 1972). As 
stated above, however, caution ih advised in drawing global con- 
clusions from these data since many other unmeasure-c! inter- 
vening variables may have affected *\is improvement in CPA. 

In summary, we can draw two conclusions about the 
feet of criterion task variables on SQ3R: 

1. Successful performance following the use of sq3R 
may require several applications of the strategy. 

2. Long term performance gain may be a factor of the 
criterion measure. 

Summary 

A strong student/orienting task/criterion task interaction 
seems to be present in the use of sq3R. Substantial, effective in- 
struction is necessary for students with lov, or medium reading 
ability to succeed with this strategy. This instruction should in- 
clude an attempt to build students' awarene&s of the effort re- 
quired in using this strategy. Success is apparent only in long 
term measures such as gpa. 
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On the other hand, we know very little about the effect 
of students' background knowledge, or of the effect of material 
variables, on this study strategy. 

Implications for instruction 

Based on this integrative review, we can conclude that 
under certain conditions, all five of these strategies help im- 
prove students' ability to study textbooks. These study strate- 
gies have the potential to improve students* acquisition of 
important material, develop deeper encoding of this informa- 
tion, encourage a more thorough integration of information 
into prior knowledge, develop cues for retention, and provide a 
permanent storage device for later review. Such strategies can 
direct students to understand and remember more of what they 
read For this potential to be realized, however, students must 
be taught how to select a study strategy on the basis of their 
knowledge of these conditions. This finding directly supports 
the intent perspective of studying. 

We suggest that the individual and combined effects of 
10 of the 1 1 variables we used to examine the literature must be 
considered when teaching students to use these study strate- 
gies. The 1 variable that we cannot conclude has an effect on 
these study strategies is the content area of the material to 
which the strategies will be applied. The great majority of stud- 
ies we reviewed did not manipulate this variable. Because of the 
predominate use of social science materials, our research review 
does not allow us to draw conclusions about the effects of these 
study strategies on other content areas. 

We conclude that underlining and notetaking should not 
be taught to students who are developmentally unable to han- 
dle college-level material Our review suggests that students 
with low reading ability will not profit from underiinlng or 
notetaking if the material is considered '*hard" because of read- 
ability length, or implicit structure, nor will students benefit if 
they are not allowed to review before the criterion task. This 
interaction seems to be the result of students' inability to recog- 
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nize what is important in t' .ext (i.e., the main or high struc- 
tural ideas). There is some evidence, however, that once 
students with low reading ability have been taught hovv to find 
these main ideas and how to review what has been underlined 
or noted, they can learn to use underlining or nott:aking effec- 
tively. Such instruction must center around a strategic approach 
to reading (Baker & Brown, 1984). 

Students must be taught to recognize and take note of 
the explicit structure provided l>y the author to help in encod- 
ing and subsequent recall. If the structure is implicit, on the 
other hand, students must be taught how to engage their back- 
ground knowledge to construct a personal structure to help in 
encoding and recall. Furthermore, students must be taught how 
to monitor the processing they engage in when underlining or 
notetaking in relationship to the demands of the criterion task. 
This strategic approach requires a time commitment on the part 
of the students, as well as criterion task knowledge, or knowl- 
edge of what the author and the instructor want them to under- 
stand. Given this commitment, both underlining and 
notetaking strategies can bcbaid io be more effective (producing 
better performance on z criterion task) than reading or reread- 
ing, but they cannot necessarily be considered more efficient 
(i.e., less time consun^jng). Students must come to understand 
the trade-off between strategies that may produce better results 
and those that take les^ time to complete. 

Outlining, mapping, and SQ3R all tend to be more effec- 
tive for students with low and medium reading ability (after 
they have learned how to use these strategies) when the mate- 
rial is more difficult and when the opportunity for review is 
provided. Knowledge of the criterion task and whether the cri- 
terion task measures main ideas more than details also influ- 
ences effectiveness. Readers of all ability levels, however, need 
to be taught how to use these three study strategies. They also 
need instruction in how to integrate these study strategies into 
their existing repertoire of strategies. All students must be 
taught to create their outlines, maps, or sq3R questions on the 
basis of their perceptions of the criterion task. They must also 
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be taught to review their outlines, maps, or answers to their 
questions before the test. 

Finally, students must be taught to believe in and com- 
plete the extensive steps inherent in these study strategies— that 
is, the support strategies described by Dansercau (1985). Evi- 
dence suggests that unless students change their altitudes about 
these strategies, they will not be willing to continue the effort 
necessary for applying tiiem outside of the empirical setting or 
developmental classroom. This I's particularly true for sq3R, 
which requires several applications with guided feedback to 
demonstrate improved performance. Therefore, students need 
to learn about the **cost-effectiveness" (more time but better 
periomance) of study strategies like outlining, mapping, or 
SQ3R and be apprised of the metacognitive criteria they can use 
to evaluate their effective and efficient use of these strategies. 

Future Research and Instructional Avenues 

This review makes evident several specific research and 
instructional avenues. In particular, we recommend that me 
student/orienting task interaction present in these study strate- 
gies be explored further to verify the role of background knowl- 
edge in their successful use. Following the research of Nist and 
Hogrebe (1987) as well as Smith (1982) and Pugh-Smith (198''\ 
background knowledge should be manipulated within the em- 
pirical or ethnographic research paradigm to see its effect on 
performance following the use of these study strategies. 

In terms o*" research, ( ther specific metacognitive strate- 
gies need to be developed and rested that monitor the progress 
of processing toward satisfying the intent for reaching. Particu- 
larly promising is the recent work of Wade and Reynolds (1989) 
and Simpson, Stahl, and Hayes (1989). Also, it would seem war- 
ranted to continue this integrative review with the study strate- 
gies that are not directly addressed here. For example, a 
thorough exploration of rereading and summarizing is needed. 
Such an analysis has already begun, using a metaanalysis tech- 
nique (Caverly, 1985) and other integrative criteria (Cook & 
Mayer, 1983, Thomas & Rohwer, 1986; Weinstein & Mayer, 
1985). 
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In addition, other variables should be explored to deter- 
mine their individual and combined effects on these stud> strat- 
egies. Additional student variables that might be considered 
include age, attitude, and academic aptitude. Another material 
variable that we believe influences the effectiveness of study 
strategies is the relevance of the material for the students. Other 
potentially important orienting task variables are metacognitive 
knowledge and length of instruction. Finally, criterion task vari- 
ables that should be examined include intentional versus inci- 
dental types of recall, as well as what we call rlie significance of 
performance on criterion measures. Many of the studies in this 
review demonstrated statistically significant improvement with 
a 50-60 percent level of performance. This may satisfy an em- 
pirical paradigm, but it will not help a student pass a course. 
These integrative analyses should be continued in order to 
come to some consensus on the validity of each study strategy 
within the contextual constraints of the study situation. 

College reading instructors need to explore pedagogical 
techniques for teaching students how to perceive these contex- 
tual constraints, how to choose a study strategy to match those 
constraints, how to monitor the application of a given study 
strategy within a given context, and how to adjust the strategy 
or change to a new one when the choice was inappropriate. In 
other words, college reading instructors need to teach their stu- 
dents metacognitive control of study strategies. Campione and 
Armbruster (1985) discuss initial attempts at this instruction. 
Wade and Reynolds (1989) and Simpson, Stahi, and Hayes 
(1989) prcsent other instructional strategies appl?r:able to col- 
lege age students. Nist and iMealey (Chapter 2, thi5 volun*^) re- 
view two new attempts. A fifth avenue we ha\e explored is 
using a decision-making model to teach students how to per- 
ceive contextual constraints and choose a strategy based on 
these constraints (Figure 3). 

We use this model to teach c r students that certain 
study strategies are mo*^ efficient (i.e., less time consuming) 
tlian other stratc^^ies, but not as effective in terms of improved 
performance. Foi example, underlining and rereading strategies 
take less time but also do less to increase performance on tests 
than a notetaking strategy, v.hich in turn takes Ic^b time but 
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Figure 3 

Demand Model for Choosing Study Strategies 



Effective Efficient 

(Heavy teacher/material demands) (Light teicher/materia! demands) 

Outlinini^ N'otetaking Reading 

Mapping Summarizing Rereading 

sq3r Underiining 



does less to improve test performance than outlining, mapping, 
orSQ3R. Presenting study strategies along this continuum seems 
to help students understand that different strategies have differ 
ent strengths in different contexts. Our review suppons the ef- 
fectiveness dimension of this model; the efficiency dimension 
must be left to future empirical research or integrative and 
metaanaly tic reviews. 

After presenting the model to students, we teach them 
how^ to identify a particular strategy for each particular study 
situation. To help in this meta.^Dgnitive decision, two criteria 
are taught to students. First, a given strategy might be chosen on 
the basis of the professor's demands (t the role of the read- 
ing material in tests, lectures^ or classroom discussions). Sec- 
ond, a strategy might be chosen on the basis of material 
demands (e.g., readability, length, background knowledge 
needed, ability level required), h the demands of the professor 
and the material are heavy, a strategy that is more effective (such 
as sq3R or n: >pping) is appropriate. If the demands are light, a 
strategy that is less effective but more efficient (such as under- 
lining) makes sense. If the demands ire contrasting, a compro- 
mise strategy (such as notetaking) ib appropriate. Students are 
taught how to identify such demands and how to use these cri- 
teri . lor selecting a demand-appropriate study strategy. Prelimi- 
nary evidence based on student feedback is encouraging. 
Further research needs to be completed regarding the place- 
ment of each strategy along the dual continuum of effectiveness 
and efficiency 
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A general conclusion that seems evident from this review 
of research is that most study strategies are effective, but no one 
study strategy is appropriate for all students in all b^udy situa- 
tions. This theoretical position has been argued elsewhere 
(/nderson & Armbrusijr, 1984; Elshout-Mohr, 1983; Ford, 
1981; LauriUard, 1979; McKeachie, 1988; Schumacher, 1987) 
and has been verified here. To help their students deal with the 
variety of demands they face in higher education, college read- 
ing instructors should teach students to expand their repenoire 
of study strategies. 
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The Value of 
Taking Kotes 
During Lectures 

Thomas H. Anderson 
Bonnie B. Armbruster 



College students typically spend 10 or more hours 
per week attending lectures. How can they make 
the most efficient use of that time? Is the time-honored sugges- 
tion to libten carefully and take good aotes a sound one? If taking 
notes is helpful, how is it helpful? Seward (1910) answered some 
of these questions in about the same way many experts do : jday, 
by proposing two functions of notetaking: 

Abk uur friend, the average btiuleni, what ib the u^e uf uking notcb, and he 
will answer without hesitation. VChj, to preicrve a record of what a kvturer 
has i>aid, for th^: saK< of future u^e, ei>peciall> in reviewing for cxa>iunations 
(p. 1). 

Our notes should, indeed, be useful for purposes of review yet that 
uicfubcss -s nut their due: *alue. They should be full, yet contain only what 
the ' .ind has accepted as Mgnificant. The practical v Auc of oar notes vvill 
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take care of itself as a matter of secondar) hTiporiance if v\c dc\ote oursehcs 
v.holly to their main purposes— to make us alert, clearheaded, and responsi 
bleas we listen to a lecture, and to ser\e as a read) test of the firmness of our 
grasp (p. 9). 

These two purposes, identified by Seward 80 years ago, 
are still the hypothesized functions of no^ ^taking. Today the 
functions are common'y labeled **extemal storage" and * en- 
coding." The idea behind encoding is that the process of taking 
notes helps the notetaker learn and rcmetnber information, the 
exiemal storage hypothesis postulates •^hat the value of taking 
notes lies in preserving information for later use, such as review 
before an examination. Thus, the encoding and external storage 
functions offer two opportunities fur learning information 
from a lecture: once while listening and recording notes and 
again while reviewing or studying the notes prior to an exami- 
nation. 

Recent theory and research in cognitive psychology sug- 
gest how taking notes on a lecture may "^fect learning af both 
the listening/encodin^^ ,nd reviewing/studying stages. In this 
chapter, we review t.ie research on taking notes during lecturcb 
from a cognitive psychology perspective and dmw implications 
for college instruction. 

A Perspecf^ive from Cognitive Psychology 

We have found the conceptual frameworks of levels of 
processing (Anderson, 1970, 1972; Craik & Lockhart, 1972) 
and the lelated transfer approoriate processing (Morris, 
Bransford, & Franks, 1977) to be particularly useful in interpret- 
ing the research literature on listening and notetaking. (Br^tzing 
& Kulhavy, 1979, and Kiewra, 1985a, ha^'e also used the trans- 
fer appropriate processing framework to "lelp conceptualize the 
effects of notetak'*' 3 strategies.) 

According to the concept of levels of processing, infor- 
niaticii is processed in a hierarchy of stage.^^, from an analysis of 
surface, physical, or sensory features to a deeper semantic anal- 
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ysis involving the extraction of meaning. The level of analysis 
performed on incoming information determines what gets 
stored In memory. A deeper, semantic processing of informa- 
tion is a5*=;.jmed to be necessary for long term memory. 

The idea of levels of processing is not without its critics. 
For example, Eysenck (1978) claims that no suitable criteria are 
available for indexing either the depth or the breadth of encod- 
ing. Lockhart and Craik (1978) agree that the definition of 
depth IS somewhat circular and that the hypothesis cannot be 
classified as a theorj^ but they contend that it possesses consid- 
erable heuristic value. In this chapter, we build on the heuristic 
value of this model with no claims as to its theoretical purity. 

The iu/els of processing framework suggests that what is 
karned from listening or reading is a function of two mteracting 
factors: 

1. The amount and type of cognitive effort given to 
processing the information. Different cognitive activ- 
ities involve different levels of processing. 

2. The nature of the input information. Many character- 
istics of the incoming information affect cognitive 
processing, including familiarity of content, concept 
load (number and density of ideas), and organization. 



The conceptual framework of transfer appropriate pro- 
cessmg (Morris, Bransford, & Franks, 1977) suggests another 
important factor influencing what is learned from listening or 
reading: the learner's purposes or goals. 

According to the concept of transfer appropriate proc- 
essing, pai ticular types of processing are not inherently deep or 
shallow, tht^ir level depends on the learner's goals. Thus, the 
value of particular processing activities must be defined in rela- 
tion to the particular goals of the learner. For example, if the 
learner *s purpose is to attend to the '"superficial" aspects of 
text— for instance, the nunber of multisyllabic words— deeper, 
more meaningful processing is not appropriate and may actu- 
ally impede encoding of the target material. Transfer appropri- 
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are processing suggests that learners' knowledge or 
expectations about what they will do with^the input informa- 
tion will guide the wa^ they choose to process thf. information 
(Anderson & Armbruster, 1984). 

Encoding Hyp(^thesb Implications 

We believe that the concepts of levels of processing and 
transfer appropriate processing have three main implications 
for the encoding hypothesis. First, theoretically the student 
could take notes at any level of processing. An example of note- 
taking while processing the information at a very superficial 
level is the verbatim script a secrctarj' makes using shorthand or 
the script made by a court recorder during a t ial. A somewhat 
deeper level of processing is involved in selectively noting in- 
formaiion -for instance, identifying a,.d recording main ideas 
that a speaker highlights. Finally, a deep, semantic level of proc- 
essing is involves in recording notes that represent .ome mean- 
ingful transformation of the input informaticn— foi example, 
notes in which the "istener paraphrases, draws inferences fruiti, 
or elaborates on points made in lecture. 

The second implication for tV e encoding hypothesis is 
that the level of processing will depend on characteristics of the 
lecture itself. Notetaking takes time and cognitive effort, both to 
process and to reco» J the information. Deeper progressing re- 
quires more time and effort than shall jw processing, recording 
the notes takes a set amount of time and effort, a^gardless of the 
level of processing involved. Of c^*urse, there is a Lmit to the 
amount of time and effort s:.idents can or will spend on taking 
notes. Therefore, lecture characttristics that affect the time and 
effort involved in taking notes will also affect processing. 

One such ':haracteristic is the rate of presenution The 
faster the lecture, the greater the restrictions on taking notes, 
especially when the notetaking involves processing at deeper 
Wels. Another characteristic related to presentation rate ia con- 
cept load. If the incoming intormation is dense, students have 
both a heavier coj^aitive processing load and more notes to re- 
cord, both of which take time. 
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The third implication for the encoding hypothesis, sug- 
gested by the concept of transfer appropriate processing, is that 
students' purposes or goals will influence notetaking during a 
lecture. College students usually have some knowledge or ex- 
pectation about .t they should bring away from the lecture; 
for example, they may know what type of question is likely lu 
appear on an upcoming examination. This knowledge or ex- 
pectation establishes a purpose for taking notes and determines 
what students will note and what kind of cognitive processing 
iiey will engage in as they record notes. 

These three implications provide a framework for inter- 
preting the results of research related to the encoding hypothe- 
sis of notetaking. 

Research Related to Encoding 

Some of the research discussed in this section consists of 
experimental tests of the encoding function. The basic experi- 
mental procedure used to determine whether the process of 
taking notes facilitates learnmg is fairiy simple. SubjectJ are ran- 
domly divided into at least two groups, those in one group take 
notes during a lecture, while the others listen to the lecture 
without taking notes. After the lecture, wiih no opportunity for 
reviewing notes, all students take the same criterion test. The 
idea is that if taking notes helps* students pro'^ess the informa- 
tion in a lecture, the notetaking group should score higher on 
the criterion test. 

Our tally intiicates that 10 experimental studies support 
the encoding hypothesis and 14 fail to do so (Table 1). Note that 
the entries in Table 1 differ in two resp^^cts from the entries in 
similar tables presented by Hartley (1983), Hartley and Davies 
(1978), and Kiewra (1985a). Unlike the summary tables of these 
other re/iewers, ours does not include studies that investigated 
notetaking while reading or studies that gave students time to 
leview (even mentally) before taking the criterion test. In addi- 
tion, we sometimes reanalyzed the data ."^ported in the original 
studies and drcw^ different conclusions from those of the inves- 
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Breakdown of Studies Testing the Encoding Hypothesis 



Support for Encoding 

Barnett, DiVesta, and 

Rogozinski, 1981 (audio) 
Berliner, 1969 (video) 
DiVest". and Gray, 1972 



DiVesta and Gray, 1973 

(2:studies) (audio) 
Maqsud, 1980 (audio) 
Peperand Mayer, 1978 
(1 study) (video) 



Taped Lectures 



No Support for Encoding 

Aiken, Thomas, and 

Shennum, 1975 (audio) 
Asli and Carlton, 1953 (film) 
Carter and Van Matre, 1975 

(audio) 
Howe, 1970 (audio) 
McClendon, 1958 (audio) 
Peper and Viayer, 1978 

(2 studies) (video) 
Riley and Dyer, 1979 (audio) 



Live Lectures 



Crawford, 1925a 
(Experiment 3) 
Jones, 1923 (1 study) 
Weiland and Kingsbury, 1979 



Annisand Davis, 1975 
Crawford, 1925a 

(Expv^rimants 1 and 2) 
Gilbert, 1975 
Jones, 1923(2 studies) 



tigators and/or reviewers. For example, we decided that only 
e\periiTient 3 from Crawford (1925a) supported the encoding 
hypothesis, while experiments 1 and 2 failed to do so. (Craw- 
ford's oth ^r experiments do not fall within our guidelines for i 
test of the encoding hypothesis.) 

It is noteworthy that among the nine studies in Table 1 
that used live lec only three show support for the encod- 
ing hypothesis. Two of these studies are quite dated, and the 
more modem one failed to randomly assign individual students 
to treatment groups. Clearly, then, any effect of notetaking on 
encoding is difficult ;o demonstrate, especially in * ctual class- 
room settings. Nonetheless, it is possible to explain and inter- 
pret the results of several studies in terms of the implications we 
drew from the two processing models. 
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Quolitative Differences In Processing 

Among t*^e research related to the encoding hypothesis 
are two studies showing that students engage in qualitatively 
different kinds of processing when taking notes as opposed to 
when listening only. In the first of three experiments reported 
by Peper and Mayer (1978), subjects either listened only or lis- 
tened and took notes during a l6-minute videotaped lecture on 
the Fortran computer language. They then took a test consisting 
of both generative items (which required subjects to write a 
computer program to solve a problem) and interpretive items 
(which were least similar to how the information was presented 
and thus required **far transfer" of knowledge). Results indi- 
cated a significant interaction between problem type and note- 
taking effectiveness, notetakers did better on interpretive items, 
and nonnotetakers did better on generative items. The second 
experiment essentially replicated the results of the first experi- 
ment, except with different lecture content. In the third experi- 
ment, subjects again listened to the Fortran lecture. Results on a 
free recall test revealed an interaction between notetaking and 
the types of items recalled. The notetakers remembered more 
about how a computer operates and included more intrusions, 
while the listen-only group recalled more technical symbols. 
The notetakers also produced more coherendy patterned re- 
calls, indicating that the learned information was structured dif* 
ferently. Thus (he three experiments in the Peper and Mayer 
study demonstrate that nrtetaking cati involve qualitative dif* 
ferences in cognitive processing during either input or recall. 

A study reported by Howe (1976) provides additional ev- 
idence that notetaking entails different cognitive processing 
than does listening only In this study, subjects were asked to 
take notes as they listened to an audio taped excerpt from a 
novel. They then relinquished their notes for anal)^is. Results 
on a free recall test given one v.eek later showed that noted 
itt.ms had a 0.34 probability of be^ng recalled, while items not 
noted had only a 0.05 probability of being recalled. In other 
wc;ds, subjects were almost seven times more likely to recall 
information that appeared in their notes than information not 
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recorded. Howe also developed the notion of ''efficient" note- 
taking— the ratio of the number of meaningful ideas to the 
number of words used to record those ideas. The positive cor- 
relation between the efficient note index and the number of 
meaningful units recalled on the test was significant (0.53), thus 
indicating that what students chose to note was processed dif- 
ferently than other information. 

A result similar to Howe s finding on efficient notetaking 
is reported by Maqsud (1980). In two experiments, college stu- 
dents classified as short or long notetakers either listened onl)' 
or listened and took notes during a 2,200-word audiotaped lee- 
ture presented at 1 10 words a minute. Students who took brief 
notes recalled more information units than those who took de* 
tailed notes. Perhaps Maqsud's short notetakers are similar to 
Howe s efficient notetakers, with short, efficient notes reflect- 
ing deeper cognitive processing of the information. Short note- 
takers may parse and summarize a segment of lecture 
information, then search their memory to see if they know a 
word or phrase that represents that summary If they do have 
such a label, they record it. On the other hand, iong notetakers 
may be less likely to summarize ^ search memorj, instead re- 
cording a more literal representation of the information. 

Care must be exercised in interpreting Maqsud s results 
since the students were categorized into treatment groups based 
on their notetaking history in his course. This technique can 
confound important independent variables. Fc- example, short 
notetakers may be more motivated and intelligent than long 
notetakers. Without random assignment to treatment groups, 
one cannot be sure whether some variables will be con- 
founded, consequently affecting the criterion measure. 



Lecture Effects 

Other research related to the encoding hypothesis pro- 
vides evidence that cognitive r jce^sing is affected by charac- 
teristics of the lectnre, particularly presentation rate and 
information density. 
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We found some data on lecture presentation rates in a 
typical college course. Maddox and Hoole (1975) report the 
highest lecturing rate at 1 14 words a minute, while Fisher and 
Harris (1973) report the lowest rate at 44 words a minute, Nye 
(1978) refers to an in-between index of 84 words a minute. Ob- 
viously, the rate of presentation varies widely, depending both 
on speech rate and on how often and how long the lecturer 
pauses to entertain questions or discussion, writes on the chalk- 
board, or otherwise interrupts the presentation of the lecture 
material. 

Evidence for the influence of presentation rate on the 
ability to process information from a lecture is found in a study 
by Aiken, Thomas, and Shennum (1975"^. Subjects listened to an 
audiotaped four-part lecture that was presented in one of three 
ways: once at a rate of 120 words a minute, once at 240 words a 
minute, i\ ice at 240 words a minute. Students e />er took 
notes during the lecture or listened only. The faster speed of 
240 words a minute impeded recall, suggesting that a fast rate 
interferes with deeper cognitive processing. This study also 
provides evidence of the effect of information density on recall. 
Some subjects in the study listened to a low-density lecture (106 
information units per 2,000 words), while others heard a high 
density lecture (206 information units per 2,000 words). Sub- 
jects who listened to the low-d(*nsity lecture recalled more 
information units, or facts, than did those who listened to the 
high-density lecture, suggesting that the dense content over- 
loaded subjects* cognitive processing capabilities. 

The Aiken, Thoma;s, and Shennum (1975) study also 
provides evidence on th, effects of taking notes at different 
times. In the stddy, su3je».is who took notes did so either dur- 
ing the four lecture segments (parallel notetakii ^) or during 
breaks between lecture segments (spa^ird notetaking). Spaced 
note takers recalled more information units than did parallel 
note takers. We suggest that characteristics of the lecture pre- 
cluded dec per processing by parallel notetakers. Remember that 
the slowest presentation rate in this study was 120 words a min- 
ute, well above the typical presentation rates reported by other 
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researchers. Also, the density of information w'as quite high tor 
some parallel notetakers. The requirement of taking notes whMe 
listen: ig to dense, rapidly presented information could well 
have impeded deep cognitive processing of the information be- 
cause the combination of listening and taking notes exceeded 
the students* cognitive capacity. 

In studies by DiVesta and Gray (1972, 1973), one possi- 
ble explanation that arises for this support for the encoding hy- 
pothesis of notetaking is that certain characteristics of the 
lecture were amenable to deeper processing by notetakers. In 
these studies, subjects listened to 5*minute audiot:iped lectures 
presented at 100 words a minute. We aigue this was probabh' 
little enough information presented at low enough speeds to al- 
low deeper processing while subjects recorded notes. 

In contrast to studies supporting the encoding h) pothc- 
sis, *"onsupportive studies had lecture conditions that were not 
conducive to deeper cognitive proces:,ing b) notetakers. For ex 
ample, in a study by Ash and Carlton (1933), college studem* 
viewed two 20-minute informational films. Some students took 
notes while viewing the filnis, others did not. Multiple choice 
and objective item tests were administered i..imediatel) after 
the films. For one film, the test scores of the two groups 
showed no statistically significant differences, for the other 
filni, the notetakers scored significantl) lower than the non- 
notetakers. We do not find these results surprising. Since films 
are characterized b) concurrent streams of verbal and pictorial 
information, they often have a heav) information load. There 
fore, it is likely that the require^menl of Liking notes while at- 
tending to a variety of information sources interfered with 
students' cognitive processing. 

In a sn"dy by Peters (1972), college students either lis- 
tened only or listened and tc jk notes during an audioUiped lec- 
ture presented at two rates, 146 and 202 words a minute. On a 
25-item multiple choice test (with a suspiciously low internal 
consistency reliabilit)), subject, who did not take notes scored 
significantly higher than did subjects who took notes. Once 
again, we are not surprised at the results. The presentation rates 
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of 146 and 202 words a minute are a:nong the highest of any 
study we reviewed. Also, the lecture, on the topic of steel as an 
alloy, was probably dense with unfamiliar, difficult information. 
Given these fectcrs, the additional requirement of taking notes 
is likely to have interfered with the cognitive processing of the 
note takers. 

Students' Purposes 

In addition to the characteristics of th^ -^cture itself, stu- 
dents' purposes or goals can influence how they take notes dur- 
ing a lecture. In the absence of specific information to the 
contrary, most college students assume that they will tested 
on main ideas or important points and therefore try to record 
these ideas in their notes. 

Research provides scr-iC evidence that this is so. Several 
rcbearchero have analyzed student nofes and compared the 
overlap with the lecture script and/or a se: of "ideaV* notes. 
(Ideal notes were compiled by the lecturer or a teaching assist- 
ant and were based on the lecturer's notes or script.) Such anal- 
yses show that, on average, students note a little more than 
one-half of the ideas from the lecture. One study showed that 
students recorded 60 percent of ideal notes (Locke, 1977), an- 
other showed 53 percent of relevant material (Crawford, 
1925b), a third, 52 percent of ideal notes (Maddox & Hoole, 
1975), and a fourth, 50 percent of ideal notes (Hartley & Ca- 
meron, 1967). Since it is difficult to determine fix^m these stud- 
ies how WM y of these ideal notes might be considered main 
points, we cannot tell how manj main points students recorded 
in these studies. Nye (1978) analyzed students* notes differently 
and showed that they recorded 70 percent of the main points 
and 33 percent of minor points. On average, 50 percent of all 
lecture points were recorded — a value very consistent with 
those reported above. Thjs, it appears tbnt students typically 
record between 50 and 70 percent of the main ideas from a lec- 
ture. 

Research also shows that certain conditions of the lec- 
ture situation can influence what students note. Maddox and 
Iloole (1975) reported that 70 to 96 percent of students were 
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likely to note ideas when they were: (1) v/ritten on a chalkboard 
by the lecturer (a finding also reported by Locke, 1977), (2) dic- 
tated in the form of headings or subheadings, (3) read aloud s 
numbered points, (4) given strong signaling, or (5) repeated or 
restated. Maddox and Hoole also reported that students were 
not likely to note ideas when the lecturer: (i) was standing 
away from the lecture notes, (2) used ideas in a joke, or (3) used 
visual aids (an observation also made by Hartley & Cameron, 
1967). Students were also unlikely to take notes when another 
student asked a question of the lecturer. Apparently, tue stu- 
dents in the research studies cited above had learned that cer- 
tain lecture conditions sensed as cues for what was likely or 
unlikely to app r on examinations, this expecJation shaped 
tl-cir notetaking behavior. 

One condition of the lecture situation that influences 
students' goals, and therefore their note >iking behavior, is spe- 
cific directions about what to note or how to note it. One rele- 
vant study is reported by Barnett, Di\^va, and Rogozinski 
(1981). In this study, college stud^'nts were told that they were 
m an experiment and would be tested later. Then they listened 
to an 1,300-word lecture on "The History of Roads ia Amer- 
ica" presented at 120 words a minute. Some students listened 
only, some listened and took notes, and some listened and were 
given notes. The students who took notes were told to listen 
carefully, identify' key ideas, and place them in outline foi ^ 
The notes that were given to students contained most of the 
important ideas fn n the lecture in outline form, these students 
w^re told not to .ke additional notes. Immediately after the 
lecture, some subjects engaged in a 20-minute "filLt task" that 
required them to mentally manipulate objects in space. (Other 
students engaged in more relevant types of review activities, 
discussed later in this Jihaptcr, here we are concerned only with 
the filler task, no-rcvic.v group.) 

On a 20-item cued response test, the listening-only 
group obtained a mean score of 3.2 items correct, compared 
with the take-notes group mean of 8.2, a stiuistically significant 
difference. (The 5.9 mean of the group that was given notes did 
not differ significantly from the m<..,rs of either the listening- 
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only group or the take-notes group.) The 256 percent margin of 
superiority' for notetakers over nonnotetakers is clear evidence 
that notetaking can facilitate cognitive processing. We think that 
notetaWng was particularly effective in this study because the 
subjects were encouraged to take notes in a ^^'ay that entailed 
relatively deep cognitive processing of the information: sub- 
jects could hardly take notes on main ideas organized into an 
outline without processing the information at a fairly deep 
level. 

Finally, in a study by Kiewra and Fletcher (1984), under- 
graduate students were instructed to take factual, conceptual, 
or relational notes while listening to a taped lecture. Factual 
notes were described as those that record factual information or 
details, conceptual notes as those that summarize only main 
ideas, and relational notes as those that relate the main ideas to 
new situations. An analysis of their notes inculcates that nriost 
students took conceptual notes irrespective of the instructions 
^ ,'en. The group that was instructed to take only factual notes 
took more total notes (factual plus conceptual and relational) 
than the other two groups. Kiewra and Fletcher concluded that 
notetaking behavior was only modeiately manipulated. Moder- 
ate manipulation seems like a reasonable outcome since these 
students had no notetaking training to change their natural in- 
clination to record mostly main ideas v^ye, 1978). 

From our review of the research testing the encoding hy- 
pothesis, we conclude that students can remember more about 
main points if ihey take notes on them than if they listen with- 
out taking notes. We suspect this is true only under certain con 
ditions, however: (1) when the lecture situation (including such 
factors as speed of presentation and density of ideas) is such 
that taldng notes does not interfere with cognitive processing, 
and (Z) when students are able to tike the kind of notes that 
email deep processing of the input information, or at least proc- 
essing appropriate to the criterion test. 

External Storage Hypothesis Implications 

The levels of processing and transfer appropriate proc- 
essing models also have implications for the hypothesized ex- 
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ternal storage function of notetaking. First, as witii the 
encoding state, any le\'el of processing could be taking place as 
students review notes before an examination. Students could do 
anything from skimming their notes (shallow processing) to 
meaningfuUy transforming their notes by outlining or elaborat- 
ing them (deep processing). 

A second implication for the external storage hypothesis 
is that the level of processing students use while studying notes 
is heavily influenced by characteristics of the notes. A5 the con- 
cept of transfer appropriate processing suggests, among the im- 
portant characteristics of the notes is their abiHty to cue recall 
or reconstruction of information needed for the criterion test. 
In most cases, the abiUty to cue recall or reconstruction is prob- 
ably a function of the degree of correspondence between the 
notes and the original lecture. The influence of the notes also 
varies with the time between taking notes and studying them: 
the greater the time elapsed, the greater the influence of the 
notes on learning outcomes. This relationship holds because in- 
formation processed earlier is more likely to have been forgot- 
ten than information processed more recently. 

A third implicatior for the external storage hypothesis is 
that the students' purposes or goals wiU influence how they 
choose to process their notes during review. Presumably, moti- 
vated college students will try to deeply process the informa- 
tion they know or expect will be on the upcoming 
examination. Their ability to do so will be constrained by the 
content of their notes (as discussed above) and the time availa- 
ble for study 

These implications provide a framework for interprctmg 
the results of research related to the external storage hypothesis 
of notetaking. 

Research Related to External Storage 

In this section we di.'scuss both correlational and experi- 
mental studies. The correlational studies were not specifically 
designed to test the external storage hypothesis; rather, their 
purpose was to investigate the general relationship between 
notetaking and some criterion measure without regard to 
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whether learning occurred during either listening or review. In 
these naturalistic studies (Collingwocd & Hughes, 1978; 
Crawford, 1925b; Locke, 1977), students took notes during a 
lecture and were tested later. The researchers did not determine 
whether students actually reviewed their notes; however, sine* 
the criterion tests were regular course examinations, it is likely 
that students did so. Also, the delay between the lecture and the 
criterion test in these studies makes the external storage func- 
tion more plausible as an explanation of the results. The longer 
the delay bet\<een listening and testing, the less the effect of 
initial processing during the encoding stage because of how 
much students would have forgotten in the interim. 

Researchers interested in experimentally testing the ex- 
ternal storage hypothesis have usually tested it in conjunction 
with the encoding hypothesis. Therefore, a typical design in- 
cludes groups that listen only and review provided notes, 
groups that take notes and review either their own or provided 
notes, and groups that take notes but do not review prior to the 
criterion test. Ideally, there should be a delay between the time 
of Uste'iingand the review (to decrease the effect of initial proc- 
essin;^ during the encoding stage), and the criterion test should 
imniediately follow the review. Presumably, if the only or pri- 
mary function of notetaking is external storage, the group that 
listens and reviews provided notes will outperform the other 
two groups on the criterion test. 

Of the 15 studies we discuss in the next section, all pro- 
vide some support for the external storage hypothesis. Obvi- 
ously, researchers have found it easie** to demonstrate the 
external storage hypothesis than the encoding hypothesis. 

Congr uence Betweon Notes and Tests 

Several correlational studies we reviewed investigated 
the influence of note characteristics on learning outcomes. In 
general, these studies suggest that the greater the congruence 
between the information in the notes available for review and 
the information required on the criterion test, the better the 
learning outcomes. 
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Crawford (1925b) lectured in seven classes to a total of 
211 students, who took notes in their usual manner. Between 2 
and 35 days after the lectures, the students took announced 
quizzes on the lecture material. Most of the quizzes were essen- 
tially free recall tests of the lectures. After the quizzes, the stu- 
dents' notes were collected and analyzed. The points covered in 
the lectures were compared with those recorded in the notes 
and on the quizzes. Crawford found a significant positive corre- 
lation between the number of points recorded in the notes and 
the number recalled on the qu?z. Furthermore, points noted 
correctly had a 0.50 correlation with correct quiz answers. 
Vaguely noted points tended to have a near zero or negative 
correlation with correct quiz answers. Points omitted from the 
notes had only a 0.14 probability of being answered correctly 
on the quiz. 

In a naturalistic study completed more recently, Locke 
(1977) analyzed the notes taken during lectures and the course 
grades earned by l6l students in 12 courses. He found a signifi- 
cant positive correlation between completeness of lecture notes 
and course grades (although this relationship held only for the 
material not written on the chalkboard by the lecturer). 

Kiewra (1985a) cites a naturalistic study in which the 
number of lecture notes taken over a 4-week period had a 0.6 1 
correlation with performance on the course exam covering 
both lecture and reading material, and a 0.78 correlation with 
performance on items derived from the lecture only. 

Other studies have compared the effectiveness of having 
students review their own note.> with that of having them re- 
view supplied notes. In a naturalistic study by Collingwood and 
Hughes (1978), college students listened to three consecutive 
live lectures in their regular course in each of three notetaking 
conditions: taking notes, receiving full notes (a complete typed 
copy of the lecturer s noteo, including diagrams), and receiving 
partial notes (an edited copy of the leaurer's nof.s, including 
headings, key points, unlabeled diagram outlines, tables, and 
references). Four weeks after the last lecture, students took a 
midterm exam including multiple choice items covering the lec- 
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ture content. Students performed best when they had full notes 
and worst when they took their own notes, suggesting hat the 
more complete the notes, the better the performance. 

A naturalistic study by Powers and Powers (1978) with 
college students also presents some evidence in favor of the ef- 
fectiveness of instructor-prepared notes. During the first half of 
the term, one experimental group received instructor-prepared 
notes, while the second experimental group served as a control. 
During the second half of the term, the roles were reversed. The 
instructor-prepared notes elaborated on content presented in 
the text. Multiple choice exams administered throughout the 
term tested these elaborated concepts. During the first h?.lf of 
the term, students who received notes and those who did not 
performed similarly, with no significant differences. During the 
second haif of the term, however, students who received notes 
outperformed students who did not receive notes. Unfortu- 
nately, the authors did not provide enougli information to per- 
mit speculation about why the provided notes were effective 
only in :he second half of the term. The change could have 
been due to differences in course content, tests, instructor- 
prepared notes, or student attention. 

In ati experimental study by Annis and Davis (1975), col- 
lege students were assigned to one of several notetaking and re- 
view conditions. Two weeks after listening to a 4C-minute 
lecture on behavior modification, the students were given a 10- 
minute lecture review session followed by an examination con- 
sisting of objective ana short-answer questions. A single factor 
analysis of variance revealed significant overall differences. Al- 
though posttest multiple comparisons were not performed, the 
students who reviewed mentally or not at all received the low- 
est means, and the students who reviewed notes received the 
highest means. These results support the value of notes as an 
external storage device. Furthermore, within the group that re- 
viewed notes, the highest mean was obtained by students who 
reviewed their own and the lecturer s notes, this result suggests 
that the more complete the notes, the greater the potential for 
learning during re\'iew. 
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In the second of two experiments by Maqsud (1980), 
college students were assigned to one of four review conditions 
one week after listening to a taped lecture: some reviewed per- 
sonal lecture notes, some reviewed a teacher-prepared handout 
described as **detailed but simplified and organized" (p. 292), 
some reviewed both personal notes and the teacher-prepared 
handout, and some reviewed mentally, without notes. Three 
hours after review, students were asked to recall as much as they 
could of the lecture. Those who reviewed personal notes and 
the teacher-prepared handout had the highest recall, followed 
by those who reviewed the teacher's handout, then those who 
reviewed personal notes, and finally those who reviewed men- 
tally. The results support the value of reviewing notes over re- 
viewing mentally and again suggest that the more information 
subjects have av<iilable at the time of review, the more they are 
likely to recall. 

In three similar studies reported by Kiewra and his col- 
leagues (Kiewra, 1985b, 1985c; Kiewra & Benton, 1985), col- 
lege students listened to a 20-minute videotaped lecture with or 
V .thout taking notes. (In the Kiewra, 1985b, study, a third 
group consisted of students v/ho did not attend the lecture.) 
TWo days after the lecture, notetakers reviewed their own notes 
while listeners (and nonattenders) reviewed notes provided by 
the instructor. The provided notes contained all the critical 
points of the lecture, including main ideas, supporting details, 
and examples. In all three studies, subjects who reviewed the 
instructor s notes scored significantly higher on factual multiple 
choice tests than did subjects who reviewed their own notes. 
Kiewra attributes this effect to the nature of the review materi- 
als, reporting that the instructor's notes were far more com- 
plete, detailed, and organized than were the students' notes. 

While generally supporting the importance of ihe exter- 
nal storage function of notes. Fisher and Harris (1973) present 
some ambiguous results with respect to the idea of the more 
notes the better. In this study, college students listened to a live 
lecture presented at a rate of about 44 words a minute in one of 
five notetaking and review conditions. Immediately following 
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the lecture, the students reviewed their notes or engaged in 
mental review for 10 minutes before completing a free recall 
test and an objective test. (Note that this situation does not rep- 
resent an ideal test of the external storage hypothesis.) Three 
weeks later; the students took another objective test without re- 
view. Students v;ho were allowed to review notes generally 
scored higher on all measures than did students who reviewed 
mentally. Those who reviewed their own notes outperformed 
those who reviewed the lecturer's notes, which may have been 
anything from a full transcript to a very sketchy outline. Since 
the 'ecture was presented at a very slow rate, students could 
have made quite complete notes on their own; it is possible that 
their notes were more complete than the lecturer's notes, thus 
providing support for the importance of congruence between 
note content and criterion test requirements. Finally, even if the 
lecturer's notes were more complete than their own notes, stu- 
dents may not have had time to review them adequately during 
the short review period. 

Annis (1981) also reports results that seem to contradict 
the idea of the more notes the better In this study, college stu- 
dents listened to a live lecture in a regular classroom context. 
One group of students received a full lecture transcript and 
were told not to take notes, one received partial notes consist- 
ing of headings and key poinb with space left for taking notes, 
and a third group was given blank paper and instructed to take 
notes. The criterion test consisted of multiple choice and short 
answer items on the regular midterm 2 weeks after the lecture. 
Students who took their own notes or received partial notes 
scored significantly higher than those who received full notes. 
However, the largest performance difference on the criterion 
test was on the short answer items, a fact that may help explain 
this apparently contradictory finding. Clearly, those students 
who wrote their own notes or filled in the partial notes were 
processing infomiation in a more transfer appropriate way. The 
effect of this difference generally masked the effects of '*the 
more notes the better" principle. 
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Transfer Approprifiteness of Notes 

The congruence between notes and test is only part of 
the answer to the value of review In addition to having the 
right information available, students must process it in a trans- 
fer appropriate v/ay— that is, the way they will need to use the 
informs^tion on the criterion test. A study by Carter and Van 
Matre (1975) suggests that opportunity for review is particularly 
helpful if subjects know what and how to review. Carter and 
Van Matre had college students listen to a 17-minute taped lec- 
ture in one of four stud>ing conditions: they eithe** took and 
reviewed notes, took notes and reviewed mentally, listened only 
and reviewed mentally, or listened only and engaged in a filler 
task. Free recall tests and alternate forms of a completion test 
consisting of verbatim and paraphrase items were administered 
immediately and after 1 week. Half the subjects reviewed prior 
to the delayed test and half did not. 

The group that took and reviewed notes scored signifi- 
cantly higher than the group that took notes and reviewed men- 
tally on all tests, a result that supports the external storage 
hypothesis. In addition, the group that took and reviewed notes 
scored higher on verbatim than on paraphrase items on the de- 
layed test, while those in the other groups did not perform dif- 
ferently on the two types of items. Carter and \^n Matre (1975) 
offer the explanation that over time, differences between verba- 
tim and paraphrase performance tend to diminish, probably as 
a result of forgetting the superficially processed (verbatim) in- 
formation. However, the students who were allowed to review 
their notes prior to the delayed test had a second opportunity 
to process the information. We know that subjects had the op- 
portunity to review verbatim information, since the authors re- 
port that subjects' notes consisted largely of verbatim excerpts 
from the lecture. We suggest, too, that subjects probably ex- 
pected a test similar to the one they already had, and thus had a 
reason to process the information in a way that was appropriate 
for answering verbatim questions. These explanations are also 
supported by the fact that students who were not permitted to 
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review notes prior to the delayed test showed no significant dif- 
ferences in performance on verbatim and paraphrase tests. 

Hartley and Marshall (1974) provide additional evidence 
that review is particularly helpful if subjects have the right in- 
formation as well as some knowledge of how they will need to 
use it on the criterion test. In this naturalistic study, college stu- 
dents heard a lecture in a regular classroom contex^^ and took a 
recall test immediately afterwards. Then they were given 10 
minutes to revise their notes, after which they took the same 
test again. The students were divided into good and poor note 
takers on the basis of their relinquished notes. Although the 
good and poor notetakers scored similarly on the immediate 
test, the good notetakers improved more than did the poor 
notetakers on the second test. One possible explanation is tha^ 
althougli all students had the same knowledge of the criterion 
test at the time of review, good notetakers were better able to 
use this knowledge during review because they had better infor- 
mation available in their notes. 

Barncrt, DiVesta, and Rogozinski (1981) report an exper- 
iment designed to test the efft ct of different types of processing 
during revitTV la the experiment discussed earlier in this chap- 
ter, the authors had observed that elaborating on notes (i e., re- 
lating notes to prior knowledge) during review failed to 
improve test performance and in some cases even interfered 
with performance. They designed an experiment to test the hy- 
pothesis that students who elaborate on their notes learn quali- 
tatively different kinds of mformation than students who 
simply review their notes. In this experiment, students either 
took notes or were provided with notes. During the review ses- 
sion, they either wrote down key ideas and details from the lec- 
ture or elaborated on their notes. Eight days later, the students 
completed an individualized test containing four types of com- 
pletion items: items from the lecture itself, which were com- 
mon to all students; items from the reviews or elaborations 
created by the individual; items randomly selected from a pool 
created for subjects who reviewed their notes; and items ran- 
domly selevned from a pool created for subjects who elaborated 
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on their notes. The researchers found that students who re- 
viewed scored higher on the common items than those who 
elaborated. Thry also found that, on average, students scored 
about twice as high on items ta^cen from their own protocols 
than on items taken from the protocols of other subjects. 

Bamett, DiVesta, and Rogozinski (1981) conclude that 
elaboration during review interfered with performance on 
items requiring accurate recall because subjects were not proc- 
essing the information in a manner consistent with the way 
they needed to use the information on the test. Subjects did 
best when they were given test items congruent with the way 
they had processed the information during review. 

In the Kiewra and Benton (1985) study discussed previ- 
ously, the authors also investigated the effect of different types 
of processing during review. In Chis study, college students ei- 
thet took notes on or listened or.*y to a 20-minute videotaped 
lecture. Notes were collected aiter the lecture. Two days later, 
notetakers received their own notes back while listeners re- 
ceived the instructor s notes. Both groups also received practice 
questions designed to tap higher-order knowledge (application, 
analysis, synthesis, and problem solving). Half the subjects were 
given an answer key (feedback) for the questions. Subjects were 
given 25 minutes J:o study the notes and answer the questions 
before taking a multiple choice test consisting of factual and 
higher-order items. When feedback accompanied the practice 
questions, performance was facilitated on the factual items. The 
authors speculate that the learning resulting from completing 
the practice questions and receiving feedback proviCied an ef- 
fective framework for organizing and for recalling a^^sociated 
factual information. In other words, the activity that this exper- 
imental group engaged in during review was appropriate to the 
demands of the criterion task. 

From our review of the research testing the external stor- 
age hypothesis, we 'conclude that an important function of 
notes is their availability for use in later review or study. The 
bulk of the evidence shows that reviewing notes before a crite- 
rion test is likely to improve performance. Notej> are helpful to 



202 



ERIC 



Value of Taking Notes During Lectures 187 



the ertent that they contain the information that will be tested. 
In most cases, this probably translates as iht more information 
the better. But what students do with their notes is also impor- 
tant. Students who engage in transfer appropriate processing 
(i.e., those wlvo cognitively process the information in thek 
notes in the some way they will need to use it on the citerion 
test) will fare the best. 

A Notetaking System 

We next take a critical look at advice given by Pauk 
(1984) about taking notes from lectures. Pauk has integrated 30 
years of experience at the Cornell University Reading Research 
Center into the "Cornell System for ThK g Notes." The critical 
fcature/i of this system are presented and discussed below. 

Before the lecture: 

• TUke a few minutes to looK over your notes on the pre- 
vious lecture, to provide continuity with the lecture 
you are about to hear. 

• Record your notes completely and clearly so they will 
still have meaning for you long after you have taken 
them. 

• Strive to capture general ideas rather than illustrative 
details. 

After the lecture: 

• Consolidate your notes during your first free time af* 
ter class by reading through them to clarify handwrit* 
ing and meaning. Also underline or box in the words 
containing the main ideas. 

• Restructure the notes by reading fhem and then jot- 
ting down key words and phrases that represent your 
reflections on them. 

• Use the jottings as cues to help you recall and recite 
aloud the facts and ideas of the lecture in your own 
words. 
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Rluk (1984) appears to be advocating the use of notetak- 
ing primarily as an external storage device: 'Remember that 
your purpose is to record the lecturer's ideas for later study" (p. 
122). We suspect, however, that he does not deny the potential 
benefits of encoding: "'Notetaking does not interfere with lis- 
tening and comprehension; in fact, it helps you listen * (p. 122). 
We disagree with one aspect of Pauk's advice in that research 
shows that there are some conditions in which noretaking can 
interfere with Cdnprehension, Under those conditions in 
which one seemingly has to sacrifice either comprehension or 
notetaking, Pauk appears to recommend sacrificing comprehen- 
sion: ''Don't stop to ponder the ideas presented. By the time 
you have finished reflecting on idea number one, the lecturer 
will probably be on idea number four or five" (p. 123). In many 
lecture courses, however, we suspect that when students be- 
come confused, it would be wise for them to foi'go notetaking 
and ask the lecturer to clarify the pOiOt rather than to faithfully 
persevere v/ith the notetaking process. A successful clarification 
might help smooth out the encoding and notetaking processes 
for the remainder of the lecture. 

We are not certain what level of detail Pauk advocates in 
notetaking. For example, in one place he suggests that students 
''strive to capture general ideas rather than illustnitive details" 
(p. 128), while in another place his advice is to **make notes on 
main ideas ana on subideas, examples, and details" (p. 122^ 
Perhaps the best summary of Pauk s advice on this point :s 
"make your notes complete and clear enough so that they will 
have meaning for you weeks and months later'' (p. 125;. In gen- 
eral we think Pauk s ^idvice is consistent with our anal) sis of the 
research findings. 



Conclusions 

We raised a question at the beginning of this chapter: *'Is 
the time-honored suggestion to listen carefully and take good 
notes a sound one?" From Jur review of the research, we con- 
clude that the answer is yes, provided that the information in 
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the notes is consistent with the criterion test and that enough 
time is provided for a review of that infonnation. 

Anomer qufestion we raised was, **If taking notes is help- 
ful, how is it helpful?" In general, the research supports the en- 
coding and extenfal storage functions of notetaking proposed 
Dy Seward (1910) more than three-quarters of a century ago. 
The process of taking notes can help the notetaker learn and 
remember information, and the notes themselves can preserve 
information for later use. 

Drawing from cognitive psychology, particularly the 
concepts of levels of processing and transfer appropriate proc- 
essing, we have been able to gain some insight into the condi- 
tions of effective notetaking. From our review of the research, 
we have concluded that students potentially benefit from the 
encoding function, as long as the lecture situation permits 
deeper processing while taking notes and students take the kind 
of notes that ent?.il processing the information in the way they 
will need to use it on tne criterion test. (We emphasise that the 
benefit is only potential because most of the live lecture re- 
search is not very convincing.) Also, students can benefit from 
reviewing notes when the notes contain the information that 
will be tested and when students process the information in a 
way similar to how it will be used on the criterion test. 

Based on these conclusions, we offer the following rec- 
ommendations for college instructors and students. 

Instructors: ^^^-^-^ 

1. Lecture in a way that encourages processing the right 
information by presenting the material at a reason- 
able rate and by signaling important content (for ex- 
ample, by wnting it on the chalkboard). 

2. Design valid, reliable tests that assess students' under- 
standing of important, relevant information. Then 
give students enough information about the tests-to 
let them know how to take good notes and how to 
study them. 

3. Encourage studen*" to take notes in a way that entails 
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deep processing, and allow time for such processing. 
When lecturing on new and difficult topics, pause and 
direct students to write and think about what you are 
saying. Remember, cognition is time Cvinsuming. 

4. Since students' notes typically include only about 
one-half of the lecturer's ideas, distribute lecture 
notes if it is important for students to know a com- 
prehensive set of ide^.s. 

5. Early in a course, collect students' notes after a lecture 
and review them. Use this exercise to determine how 
well your lectures are being understood and which 
students need assistance in notetaking skills. Give 
these students advice, refer them to a general source 
on how to develop notetaking skills (for example, 
Pauk, 1984), or refer them to a study skills center di- 
rected by the university or a pnva'.c company. 

Students: 

1. Take complete notes as long as it does not interfere 
with listening and comprehending the foiormation in 
the lecture. 

2. If the speed of the lecture makes it impossible to re- 
cord the most important ideas, note the names of the 
key concepts that pass by and later supplement your 
notes with information from the textbook, lecturer 
handouts, or notes from other students. 

3. Try to take notes in a way that entails deep process- 
ing, or after the lecture revise your notes in such a 
way. 

4. Find oui as much as possible about the tests, and use 
this information as z guide for taking and studying 
notes. 

5. Study your notes before the test in a transfer appro- 
priate manner. If you anticipate multiple choice or 
short answer questions, practice asking and answer- 
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ing questions with a friend. If you anticipate an essay 
test, organize your notes around the major topics and 
commit that organization to memory. Try talking 
through the ideas from the organization with a 
friend. 

Finally, we conclude with some lingering questions that 
beg for additional research on notetaking: 

1. Under what conditions and to what extent is the Cor- 
nell or any other well-publicized notetaking system 
effective? How should such a system be modified to 
accommodate various content areas, study guides, 
examinations, and textbooks? 

2. How and when should students be taught to take 
good notes? Is early elementary school too early? Is 
college too late? 

3. Since taking notes is most effective when the notes 
are used as a means of externally storing ideas, what 
are the effects of the note providing services that are 
now prevalent on college campuses? Are there any 
advantages to using conferencing, or group notes, 
that can be generated on a network of computers? 

4. How does a good, relevant textbook differ from a set 
of good, revelant notes? Is the students' objective in 
taking notes simply to create a personalized adjunct 
textbook? 

5. What are the most effective ways of studying or re- 
viewing a set of comprehensive notes? Is reciting 
notes a reasonable way to study for a tesc? Is generat- 
ing questions from notes an effective review strategy? 

6. Are findings in the recent novice-expert literature— 
for instance, that on writing (Scardamalia & Bei^iter, 
198S) -relevant to research on notetaking and study- 
ing? Do we gain any explanatory advantages by 
thinking about notetaking a- ;ust one strategy in a 
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larger Problem-solving effort (v/here the problem is 
to leani the material find do well on the test) rather 
than as a necessar>' pro rcdure for improving compre- 
hension? 
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External Factors 
That Influence 
Study 

Victoria J. Risko 
Marino C. Alvarez 
Marilyn M. Fairbanks 

College students are expected to be self-directed and 
to use available resources effectively. Orienting stu- 
dents for successfa^ acadcxTiic achievement in college typically 
includes giving them zdvlcc on how to manage time to make 
studying effective, how to organize the study environment to 
make it conducive for learning, and how to use the library to 
complete class assignments. In this chapter we discuss time man- 
agement, study environment, and library use as factors that influ- 
ence students' study efforts. College instructors and authors of 
study skills texts often refer to these three areas as "how-to- 
study" behaviors. The goal of teaching students how to monitor 
their time and study environment and how to use library re- 
sources is to enhance their ability to make wise decisions about 
how and when to study. College students need to become profi- 
cient in controlling each of these factors in order to manage their 
own learning. 

erIc 



We decided to start our investigation of these three fac- 
tors by examining study skills texts to identify what the authors 
recommend for enhancing college students' study habits with re- 
spect to our target factors. From an inspection of the Subject 
Guide to Books in Print (1988), we generated a list of 64 study 
skills texts published between 1981 and 1988. We eliminated 45 
of these texts because they focused primarily on providing exer- 
cises for timed readings, fluency development, or practice in 
reading skills (e.g., vocabulary, word analysis), without providing 
substantial information about strategies to improve students' 
study habits. 

The remaining 19 books exhibit characteristics of texts or- 
ganized to develop reading or study strategies, as defined by 
Heinrichs and LaBranche (1986) in their classification of college 
reading texts. We conducted a content analysis of these 19 texts 
by coding information to determine the extent to which each of 
the three target areas was addressed; the nature of the informa- 
tion and suggestions given for each area so that a comparison 
between these ideas and relevant literature could be made; and 
the extent to which the authors of these study skills texts cited or 
explicitly related their suggestions to theoretical or research liter- 
ature. Each of the 19 texts contained information about at least 
one of our areas, with corresponding suggestions and strategies 
that students could adopt to enhance their study efforts. Tkble 1 
shows a sunrmary of our survey results. 

Our survey aided the development of this chapter in sev- 
eral ways. First, we were able to conclude that each study skills 
text reviewed addressed at least one target area, and usually two 
or all three of them. WTiile we discuss the specific recommenda- 
tions made by study skills authors elsewhere in this chapter, our 
review in general revealed a wide variance in the authors' inclu- 
sion of study skill areas within their texts. 

Second, most of the authors do not relate their sugges- 
tions explicitly to supporting literature. Instead, they present 
their information informally and in a conversational style. Pauk s 
(1984) view that most college students who are learning how to 
develop better study habits are not interested in reading theory 
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Relevant Areas Addressed in Current CoUege Study SkiUs Texts 



Text 



Annis, 1983 



Bradey, 1983 



Brooks, 1984 



Joffe, 1982 



McWhorter, 1986a 



McWhorter, 1986b 



McWhorter, 1987 



Pauk, 1984 



Postman, Keckler, & Schneckner, 1985 



Scales & Biggs, 1983 



Schmelzer, Khristen, & Browning, 1984 



Shepherd, 1982 
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or research references seems prevalent in the texts we surveyed. 
The authors of these books present practical, readable sugges- 
tions based on their years of experience with college students. 
Most of the authors indicate that their suggestions are supported 
by a theoretical or research base, but they do not specify such 
relationships. One text (Cohen & Poppino, 1982), organized ac- 
cording to a theoretical framework, follows the Piagetian phases 
of exploration, invention, application, and recapitulation to illus- 
trate how students can apply what they are learning. The remain- 
ing authors all present suggestions for applying their 
recommended strategies to content classes, although they do not 
indicate that they relied on a theoretical or empirical base to 
guide their recommendations. 

We believe that this treatment of the related theoretical 
and empirical research may be disadvantageous to college stu- 
dents who have stud^^ problems. Presenting the findings from re- 
search so simply can encourage college students to 
overgeneralize an author's recommendations. For example, in- 
stead of stating that research indicates that music undermines 
study efforts, it would be more accurate and appropriate for 
study skills authors to describe how separate investigations have 
identified which conditions and for which tasks musTc may be 
distracting. 

This chapter provides a review of the theoretical and em- 
pirical literature that iielates to each of the three identified areas. 
Since the authors of study skills texts generally suggest, either ex- 
plicitly or implicitly that their recommendations have a theoreti- 
cal or research basis, we were interested in determining how 
closely their suggestions did reflect the literature. For the most 
part, only literature relevant to college-age students is included. 
For each of our three areas, we organized our review to present 
(1) a brief rev iew of what the authors of the 19 study skills texts 
recommend, (2) a review of the literature related to our target 
are , and an interpretation of the correspondence between what 
is recommended and what is supported or proposed in the litera- 
ture, and (3) a discussion of the issuer addressed. We conclude 
with recommendations lur research and instruction. 
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Timr j^anagement 

Time management, the first of the three areas to be dis- 
cussed, is often difficult for college suidents. The concept of 
how time can best be allocated to serve one's needs is often 
poorly understood, and the complaint **I need mc^ time to 
study** is commonly used to explain poor study performance. 

Suggestions from Study Skills Texts 

The authors of the texts we reviewed had varied, ye! simi- 
lar, suggestions for students' use of time. Most authors of college 
study skills texts recommend aevising a schedule as a way to rc^- 
ulate time. Some authors recommend developing a flexible 
schedule based on individual needs and circumstances (Nist & 
Diehl, 1985; Pauk, 1984; Shepherd, 1984, 1987; Wood, 198^y, 
' ile others advocate a fixed time schedule (McWhorter, 1987; 
;tiriou, 1984; Walter & Siebert, 1984). 

Authors of college study skills texts often seem to make 
statement's based on personal beliefs rather than on research 
This tendency is illustrated in the mixed assortment of recom- 
mendations given under time management headings. Several 
authors organize their time management recommendations to 
contrast unhelpful and helpful time management habits. Most 
give advice focusing on what students should not do. **Abso- 
lutely no television... by far the greatest modern time waster'* 
(Pauk, 1984, p. 53); don*t **allow yourself to study more than 
the allotted time" (Walter & Siebert, 1984, p. 60). 

The statements in the.se texts often need further clarifica- 
tion or elaboration. For example: **Always try to m'^ke your 
new subject as different as possible from the subject you have 
• St finished [studying]. That way your mind can be assimilating 
one topic while you are reading about another** (Walter & 
Siebert, 1984, p. 6l). The authors of this book should have ex- 
plained more clearly how it is possible for students to be simul- 
taneously concentrating on their residing and assimilating 
information about a different topic. Further, it is not clear how 
different the topics need to be for effective studying of each. 
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As indicated earlier, many authors refer vaguely to re- 
search to support their claims rather than stating specific 
sources for their information. Statements such as **Research 
studies have consistently showed that the most successful 
students stick to a very strict schedule of work and play" 
(Sotiriou, 1984, p. 11), for example, do not provide read- 
ers with enough information about the nature of the research 
that was conducted. Another example is authors' frequent as- 
sertion that ''research studies** support the idea that exercise 
gives bodies more energy. And Walter and Siebert (1984), as 
well as Sotiriou, claim general research support for a relation- 
ship between memorization ability and amount of sleep. 

While such well-intentioned advice appears logical and 
even may be supported in related literature, these suggestions 
tend to overgeneralize what needs to be done and to avoid an- 
swering specific questions about time management. For exam- 
ple, is a schedule good for everyone? How much flexibility 
should be allowed? When might extenuating circumstances al- 
low one to deviate from a schedule? Does everyone need to eat 
a healthy breakfast? Is it imperative to stop studymg at a given 
time? Questions such as these identify areas that need further 
investigation. 

Time management seems to involve two main issues: the 
time needed for learning and the time spent on learning. A re- 
lated issue that is seldom mentioned in the texts surveyed is the 
relationship between the type of task to be learned and the time 
needed for and spent on learning it. Authors of study skills t^xts 
focus instead on how to develop schedules to regulate time and 
how to adhere to these schedules. Our review of the related lit- 
erature supports the need for further studies « ither to validate 
current advice given to college students or to suggest more pre- 
cise procedures for using schedules to manage time. 

Reloted Literature 

Our goals for the literature review on time management 
were (1) to identify theoretical and/or empirical support for 
time use as a factor that contributes to effective study, and (2) to 
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examine the relationship between time and otner study varia- 
bles. We have categorized the information we gathered into two 
groups: time variance according to student learning needs, and 
the nature of the learning tasks. As indicated by Carroll's (1963) 
earJier model of school learning, five factors affect student 
learning rates: aptitude, ability to understand, engaged time on 
task, allocated instructional time, and quality of instruction. 
Since these factors are interdependent, the study of time capnot 
preclude a closer investigation of the impact of these related 
factors on learning. 

Time variance. Time variance, or the amount of time 
needed for learning, is highly idiosyncratic, Arlin (1984a, 
1984b) und others (Atkinson, 1968; Carroll, 1967; Glazer, 
1968; Washbourne, Vogel, & Gray, 1926) have demonstrated 
the need for time adjustment according to both the task as- 
signed and students' learning needs. Describing the learning 
time of fast and slow learners, the> indicated that the use of 
time for each group remained relatively constant regardless of 
task demands. In none of these studies did students use ^css 
than the allotted time, even when tasks may have require'd less 
time expenditure. It seems that students who want to use study 
time efficiently need to learn to discriminate between time allo- 
cated for learning and time needed for learning (Schmelzer et 
al.. 1987). 

Meaningful learning, defined as the process of linking 
new concepts with those already stored in memor>\ is depen- 
dent on the degree of associational background a learner has 
with these concepts (Johnson, 1975V Understanding concepts 
depends on the learner's conceptual organization, the clarity of 
ideas presented, and the relevance of learninp the new material 
(Alvarez, 1983). However, as Frijda (1978) n-entions, informa- 
tion as encounterd in a teaching and learning situation is un- 
likely to be presented in a form ideally matched to the learner's 
existing knowledge structure. Study skills texts need to ac- 
knowledge that use of time must be flexible and responsive to 
students' learning needs. Rather than advising students to ad- 
here to d uniform allocation of time, these texts should make it 
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clear that time demands will differ depending on factors such 
as prior knowledge, the context in which infonrifxtion is prc- 
sentcd, and the nature of the learning task (Shuell, 1986). 

Nature of the learning task. Most of the research on 
time management neglects to address how the type of learning 
task may affL-ct the amount of time needed to learn. As Get- 
tinger (1984) states, research is needed in both clarifying task 
conditions and determining the relationship between task de- 
mands and time allocation. Time becomes a more important 
variable when it is measured against the difficulty of the task to 
be learned. Both Carroll (1970) and Bloom (1974) have esti- 
mated that approximately 90 percent of students can master 
some school learning tasks within a 5. 1 time ratio (that is, the 
slowest 5 percent of the students require about five times more 
time to complete the assignment correctly than the fastest 5 
percent). This 5:1 ratio is used to provide an approximation of 
individual differences among students when completing tasks. 
However, as Lyon (1984) notes, there is a paucity of research 
investigating how this ratio may var>' according to different uisk 
demands; for example, it is possible that the ratio increases with 
the difficulty of the task. 

Lyon conducted one study that investigated how the 
nature of the learning uisk may affect time allocation (see also 
Lyon & Gettinger, 1985). Lyon studied the effect of learning 
tasks related to Bloom s (1956) wxonomy levels of knowledge, 
comprehension, and application. The results indicated thai stu- 
dents need more time to karn Lisks that arc higher in the hierar- 
chical order Most students could learn literal knowledge uisks 
within the 5:1 ratio proposed by Bloom (1974) and Carroll 
(19"'0), but only one-third were able to complete learning tasks 
requiring application in a similar amount of time. Lyon (1984) 
concluded that junior high students who can handle literal 
knowledge wsks need to be wught independent study strategies 
for those taslcs that require interpretive and applicative modes 
of comprehension. Although his subjects were seventh and 
eighth graders, the findings may well apply to college freshmen 
who are classified as remedial students. Obviously, this is an 
area that needs further research. 
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How a student manages time is personal and idiosyn- 
crstir. ^Vhen the authors of study skills texts state that time 
needs to be managed, they are giving good and well-inten- 
tioned advice. However, when they make dogmatic stat^ .nenis 
about how this time must be scheduled, they go bc)^ond sound 
reasoning. When this occurs, authors' recommendations be- 
come guided by what they would like to see happen rather thai 
by what research says should happen. The idea that students 
need to manage time in a constrained manner in order 'o be- 
come successftil learners needs to be substantiated befoire au- 
thors of college study skills texts make absolute Matements 
about using scheduled time. 

impltcatfons 

There arc differences between the Ume needed for learn- 
ing, the time spent on learning (f ime on task does not necessar- 
ily guarantee learning), the types of tasks students are asked to 
learn, and the quality and presentation of instruction. Research 
seems to be lacking on the type and level of tasks college stu- 
dents need to learn and the time needed to learn them (Carroll, 
1989; Gettinger, 1984, 1985). It is one thing to know about in- 
dependent learning/study strategies and another to have the in- 
clination and ability to apply these strategies to different kinds 
of learning tasks. 

McPartland and Karw Jt (1979) advocate a need for fur- 
ther research measuring the extent to which learning time can 
be reduced thror.gh appropriate t>pes and amounts of instruc- 
tion. Further research dealing with the quality of instruction 
and presentation of material needs to be conducted with col- 
lege students of varjing abilities. Reseaixhers have studied the 
effects of teacher-assisted learning strategies on college stu- 
dents' performance. These strategies incluc^*" the use of adi i^n^e 
organizers (Ausubel, I960, 1968), structured overviews or 
graphic organizers (Barron, 1969; Earle, 1969; Earie & Barron. 
1973)» concept maps and vee diagrams (Gowin, 1987; Novak & 
Gov/in, 1984), thematic organizers (Alvarez & Risko, 1982, 
1989), and case analyses (Christensen, 1987; Dewing, 1931; 
Gragg, 1954; Hunt, 1951; Lawrence, ^953) in single and icd 
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contexts. More research needs to be conducted to determine 
whether these kinds of strategies can help college students bet- 
ter manage their time. 

Another area that needs more study is procrastination 
and its effect on students' use of scheduled study time. Ottens 
(1982) has developed a Guaranteed Scheduling Technique de- 
signed to overcome procrastination tendencies in college stu- 
dents. Students using this technique record the amount of time 
spent on studies each day and work with counselors to assess 
how much they procrastinate and to help establish self-control 
and time management. Aside from this work, however, research 
in this area is scarce. Factors influencing procrastination that 
need further study include the nature and duration of an assign- 
ment, the ability to complete an assignment (knowing how), 
and the assignment's relevance. The effects of procrastination 
on the time spent on and needed for learning also need to be 
investigated. 

Study Envikonment Management 

Like time management, study environment management 
is an area over which students need to exercise some control. It 
seems logical that studying in an environment conducive to 
learning can be helpful even if scudents possess the knowledge, 
skills, and attitudes important for academic success. The spe- 
cific elements that constitute an ideal study environment are 
difficult to define, however. In addition, the extent to which 
any set of study circumstances can be ideal for all students and 
all study situations is a complex issue. 

Suggestions from Study Skills Texts 

Authors of study skills texts make many suggestions 
about where and under what circumstances students should 
study. Their advice can be broken down into four categories: 
(1) establishing a place for study, (2) minimizing or eliminating 
distractions such as peers or music, (3) determining the optimal 
degree of comfort for studying, and (4) being ready to study. 
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Establishing a place for study. Study skills texts typi- 
cally advise students to select a definite place (sometimes two 
places) to study and confine their studying to that place. Stu- 
dents at^ also usually advised not to engage in other activities in 
that designated place (Annis, 1983; McWhorter, 1986a, 1986b; 
Nist & Diehl, 1985; Pauk, 1984; Sherman, 1984; Sotiriou, 
1984; Wood, 1986). Authors vary somewhat in the explana- 
tions given for this advice, but they usually refer to the condi- 
tioning principle that if certain behaviors occur in one place, 
that place becomes a cue or signal for that behavior to occur. 
Also, some authors indicate that designation of a study area is 
one way of controlling distractions— especially auditory ones, 
since familiar sounds are often unconsciously blocked out 
while new or less familiar sounds are more distracting. 

Annis (1983) advises students to **bring your study be- 
havior under what is called stimulus control" (p. 4). She 
stresses the possible self-reinforcement o*^ reward value in- 
volved for the student who chooses to study in a place or 
places specifically reserved for study only. She admonishes stu- 
dents to "absolutely avoid incompatible activities such as lei- 
sure reading, daydreaming, or snacking" (p. 5). She also 
discusses the characteristics that should govern selection of the 
chosen study place, such as adequate heat and lighting and min- 
imal distractions. 

Bradley (1983) takes a somewhat modified approach to 
this selection of study places. While she advocates minimizing 
the number of places for study, she also suggests that at least 
one place of study be at home. She further indicates that study- 
ing in places where other activities take place, such as on the 
kitchen or dining roon^ table, might not be as debilitating to 
study as many study skills instructors and authors suggest. She 
advises students, however, that they should be conscious of the 
possibility of disruptions in such locations because of associa- 
tions with other activities, an:" suggests that they pb^ their 
study for times when others sharing the living quarters v ill be 
occupied elsewhere. 
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Controlling distractions. Study skills texts commonly 
advise students to study in places where visual and auditory dis- 
tractions are minimal. They tell students to keep pictures and 
memorabilia out of sight, and to minimize the number of ob- 
jects that suggest other activities. Walter and Siebert (1984) 
present a vivid scenario of how visual distractions can disrupt 
study. They describe a young woman attempting to study who 
is first distracted by photos that make her remember pleasant 
times in the past, then by her record albums, then by magazines 
that make her think of what she hasn't read, and finally by pho- 
tos of friends that prompt her to abandon her study attempt in 
favor of phoning her friends. 

With reference to auditory distractions, most authors 
suggest a quiet study enviropjnent, but several mention that stu- 
dents may vary in their tolerance to noise (McWhorter 19i36a, 
1986b; Pauk, 1984; Sherman, 1984). Pauk tells students who 
know they need silence while studying to seek a quiet place, 
even if it means walking several blocks to a library. Sherman as- 
serts that complete quiet can actually distract some students, 
and advises students to keep a record of the times they are dis- 
tracted when studying in order to determine their own prob- 
lems and needs. McWhorter advises students to try several 
levels of noise (quiet, soft background music, louder music or 
other noises) to see what works best for them. 

In discussing study distractions, textbook authors typi- 
cally refer to peers as factors that may divert attention from 
study. A few authors deal with the issue more specifically. 
Sotiriou (1984) advises students to locate their dorm room or 
apartment desks as far away from friends as possible. If 
study conditions prove unsuitable at home, he suggests going 
to the library but cautions students to sit away from friends to 
avoid being distracted or interrupted by conversations irrele- 
vant to the subject being studied. Walter and Siebert (1984) 
state that students who are frequently interrupted by noise, 
friends, or family should make a definite effort to change the 
behaviors of those around them. They advise students to avoid 
making rigid rules, instead asking friends or family what they 
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think is reasonable, explaining exactly what is needed, and ask- 
ing for cooperation. Similarly, Bradley (1983) expresses con- 
cern about possible interruptions when studying at home and 
seems to place a high priority on planning for productive stud). 
Students who generate a creative plan for minimizing the 
amount of time and energy taken away from study and learn* ig 
can lessen their chances of feeling victimized by those around 
them. 

Some current study skills authors (Nist & Diehl, 1985; 
Pauk 1984; Sotiriou, 1984) advise students against studying 
with music in the background. Nist and Diehl argue that **you 
cannot study efficiently with a radio or television playing, be- 
cause your attention will be divided'' (p. 15). Pauk summarizes 
13 studies (not specifically referenced in his text) pertaining to 
music and learning performance, conducted with students o'' 
varying ages and grade levels. Seven of the studies indicated 
that music was a definite distraction, five indicated no signifi- 
cant effect from music, and in one instance, the listening activ- 
ity (listening to bell ringing) was found to facilitate 
performance. Pauk concludes that music is a potential distrac- 
tor and advises students not to turn it on to avoid the risk of 
ineffective study. 

Degree of comfort. The degree to which a student 
should be comfortable when studying is a point on which au- 
thors vary considerably. Nist and Diehl (1985) advocate a 
straight, hard-b.ickcd chair, w hile Pauk grumbles that *'more ink 
and more worub have been wasted extolling the virtues of a 
stiaight-backed, hard-seated hickory chair than on any other 
single piece of study equipment'' (p. 6l). Instead, Pauk advises 
students to choose a cushioned, comfortable chair. Sherman 
(1984) and McWhorter (1986a, 1986b) state that being either 
too comfortable or too uncomfortable could distract students 
from study. Most authors advise against studying in bed. 
Bradley (1983) goes so far as to tell students that the best way to 
treat insomnia is to go to bed with a textbook. Authors also ad- 
vise that the room s lighting should be adequate and the tem- 
perature comfortable but not so warm as to induce sleepiness. 



ERJ C lerna! Factors That Influence Study ^ ^ 207 



Readiness for study. Most authors advise students to 
have books, equipment, and other materials ready for study so 
they won't have to waste time by constantly leaving the study 
area to find additional materials. Sotinou (1984) and Wood 
(1986) tell students to keep all of their books and study materi- 
als in one place, stating that keeping everything in a box will do 
if students do not have access to a desk or bookshelves oi 
their own. 

While most authors indicate that students should study 
in a designated place free from distractions, some acknowledge 
that not all students will react alike. The authors advise stu- 
dents to try out various environments, analyzing their study be- 
havior to detemine the environment that is best for them. 

Related Literature 

Theoretical and empirical literature related to study en- 
vironment management has focused on the effects of stimulus 
control on students' study habits. One group of studies has con- 
centrated on students' ability to exert rigid control over the var- 
iables in their place of study. Another set of studies has 
investigated more carefully the relationship between peer influ- 
ence and study effectiveness. A third group focuses on the in- 
fluence of music on students' ability to study. 

Place variables. The advice of study skills texts to 
choose specified places designated for study only has been 
tested to a limited degree in a series of stimulus control studies. 
In the literature, these studies are evaluated and discussed in 
tandem with studies on other self-control strategies, such as 
self-monitoring, self-reward, or problem solving (see Chapter 6, 
this volume). According to Richards (1981), who prepared a 
review of self-control studies, stimulus control or environmen- 
tal planning involves developing "an environment conducive to 
adaptive behavior * by manipulating cues associated with desir- 
able and undesirable responses (p. l64). 

Stimulus control directives are sometimes evaluated as 
part of an academic improvement package that includes study 
skills or other self-control strategies This type of evaluation 
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makes it difficult to determine the value of stimulus control in 
itself. For example, one summer school program for college stu- 
dent volunteers included 11 lessons encompassing both study 
behavior and self-control strategies (Beneke & Harris, 1972). In 
the one lesson devoted to stimulus control, students were in- 
structed to extablish one or two places as a stimulus :.nd to do 
all or most of their studying there. They were told to make sure 
their chosen place had good lighting, was free of distractions, 
and had no associations with behavior incompatible with 
studying. The total program of 1 1 lessons reportedly resulted in 
improved grade point average for three semesters following the 
study, but neither the contributions made by the stimulus con- 
trol lesson nor the extent to which students followed it could 
be determined. 

In a study with 106 college students, Fichards et al. 
(1976) combined stimulus control with siudy behavior ques- 
tionnaires and advice on study skills and compared this trea:- 
ment with six different combinations o( self-monitoring and 
study skills advice. In terms of grades, the group that received 
self-monitoring and study skills advice performed better than 
the group that received stimulus control and study skills advice, 
however, the stimulus control/study skills advice group per- 
formed better than ihe no-treatment control group. Since the 
study design did not include a control group of students who 
were given study skills advice only, it is impossible to determine 
whether the study skills advice or the stimulus control treat- 
ment was responsible for the superiority of this group over the 
control group. 

Studies in which stimulus control was evaluated as a sep- 
arate variable 1* ive not shown promising results (Richards, 
1981). Richaros ^1975) reported a study that involved 101 stu- 
dents using a pyramid design and entailing combinations of self- 
control procedures as additions to study skills advice. Stimulus 
control was included in two of the subgroups, one in combina- 
tion with self-monitoring and study skills advice, and the other 
combined with study skills advice alone. Results Indicated that 
while self-monitoring was a helpful addition to study skills ad- 
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vice, stimulus control was not. Stimulus control, self-reinforce- 
ment, and a combination of the two formed the three 
experimental group treatments in a study by Ziesat, Rosenthan, 
and White (1978) involving college students who wanted to 
eliminate procrastination behaviors. Although students in the 
experimental groups reported increased time spent on study 
and those in the control groups did not, no improvement was 
found in overall grade point average. And according to Richards 
(1981), students showed a definite dislike for stimulus control 
procedures because these procedures were too different from 
their usual study practices. They also seemed to have problems 
carrying out the procedures independendy and needed much 
direction from counselors. 

Earlier in this discussion, we stated that most authors of 
study skills texts advise students to study in one or two pre- 
selected places, to use those places for study only, and to avoid 
distractions as much as possible. This advice was based on es- 
tablished conditioning principles, which theoretically should 
operate to increase student motivation by establishing a signal 
or "set" for study (Richards, 1981). Nonetheless, attempts to 
put such advice into operation through stimulus control proce- 
dures have not to date proved highly effective in enhancing aca- 
demic performance. 

Peer influence on study effectiveness. Two major areas 
have been empirically explored in terms of peer influence on 
study effectiveness: recognizing and coping with peer-related 
distractions, and determining the positive influences of peers 
on study performance. In the first area, the study problems and 
hrtbits of adult college students (24 years of age or older) and 
students in the more typical college age range (18 to 21} were 
compared in a study that used self-report questionnaires and ex 
tensive interviews (Hogan & Hendrickson, 1984). Students in 
both age groups indicated *Tamily/roommate" as a major study 
problem. 

In a threvC-step study reported by Hefferman and 
Richards (1981), isolatic from peers during study emerged as a 
possible effective way of managing some of the problems 
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associated with peer influence during study. In the first step 
of the study, the investigators interviewed students wh had re- 
ported overcoming previous proolems in studying. The two 
methods that seemed the most btipful were planning schedules 
and studying away from peers, ia the second step of the study, 
the senior author observed 4 successful and 2 unsuccessful stu- 
dents in their natural study environments and concluded that 
peer isolation, indicated as a modified stimulus control tech- 
nique, was effective. In the third phase of the study, 45 college 
student volunteers who were seriously concerned about their 
poor study behaviors were randomly assigned to one of three 
groups: an experimental group in which students were encour- 
aged to plan schedules and study away from peers; an experi- 
menul group in which a problem-solving technique and the 
broader, more formal stimulus control procedure discussed ear- 
lier were combined; and a ni^-treatment control group. Hjffer- 
man and Richards a^ported that the first group, which studied 
away from peers and planned schedules, scored better on ex- 
aminations than either of the other two groups by a significant 
(although modest) margin. Although the authors considered the 
results promising, they advised caution in interpreting them be- 
cause of the modest difference in performance, the necessity of 
relying on self-report measures in the initial phase of the study, 
and the possibility that students who successfully devise their 
own study strategies somehow may be different from those 
who have not been successful in such attempts. 

Attempts to structure peer influence to improve study ef- 
fectiveness and academic performance have included peer tu- 
toring programs, collaborative study efforts, and residential hall 
arrangements. Fremouw and Feindler (1978) reported on a peer 
review study in which students requesting help with study skills 
were paired together as study partners: one member of each 
pair acted as a tutor to the other, after receiving training in 
study skills and self-control techniques from both psychology 
and study skills instructors. Results from interview data indi- 
cated that the students who had been trained as tutors showed 
as much improvement in study effectiveness as did those who 
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met with graduate teaching assistants in an established study 
skills program, and more than a control group. It should be 
noted that because the peer tutors were trained by both psy- 
chology and study skills instructors, they invested more prepa- 
ration time than the professional staff, who were trained only 
by the study skills instructors. Changes in grade performance 
across the groups were not significant. 

The effects of positive peer influence on study habits, as 
measured by the Brown and Holtzman Survey of vStudy Habits 
and Attitudes (Brown & Holtzman, 1967), were investigated in 
a study involving 15 pairs of college roommates (Cappella, 
Hetzler, & MacKenzie, 1983). One randomly selected member 
of each pair was told the purpose of the study and was asked to 
spend 1 hour a day for 7 days modeling good study behavior 
and encouraging the roommate .o study. At the end of the des 
ignated period, the students who had been encouraged b) their 
roommates improved considerably on the Survej of Study 
Habits and Attitudes. The roommates themsehes improved 
somewhat, but not significantly. 

The effects of voluntary, semivoluntarj^ and nonvolun- 
tarj' peer monitoring programs on college students' acaciemic 
performance have also been investigated. In these studies, stu- 
dents in 3 particular college class are paired to study together 
for a designated minimum period time each week. In one 
experiment (Fraser et al., 1977), students were assigned part- 
ners and asked to study together for at least ons*^ half hour per 
week outside of class. Both students received as a grade the av- 
erage of their individual grades. The authors reported that the 
students who studied together received sig? ficantly higher 
grades than did those in control groups not assigned to study 
with a partner. However, students voiced many complaints, es- 
pecially in the initial phases of the course, about being partly 
responsible for and affected by another student s performance. 

In three later experiments, Beaman et al. (1977) at- 
tempted to maintain the advantage of mutual study while over- 
coming some of the problems associated with mutual grade 
assignment. In he first experiment, students were required to 
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study with their assigned partner and report their study time 
each week, but grades were .■'Ot averaged and no penalties ex- 
isted for nonconformance. The researchers found that fewer 
than half of the students actually studied together for the re- 
quired period of time each week. Those who did received sig- 
nificantly higher grades than students in the control group. In 
the second experiment, student participation was requited. In- 
stead of getting an averaged grade, participating students re- 
ceived points for reaching their required amount of study time 
with their partners. These students performed better on exami- 
nations than the control group, but the difference was not st:i- 
tistically significant. The authors reported, however, that 
Several students admitted confidentially that they had falsified 
their time to receive the point, and student complaints about 
being required to study with an assigned partner continued 
throughout the semester. In the third experiment, grades wea' 
averaged for the partners, but participation was voluntary Of 
the 108 class members, only 14 volunteered for peer monitor- 
ing, and they insisted on choosing their own study partners. 
Again, paired students received higher grades; the difference ap- 
proached but Jid not reach statistical significance. The authors 
concluded that the peer monitoring idea showed promise, but 
that many details involving student reception and cooperation 
still needed to be addressed. 

Another, more expansive, effort to harness peer influ- 
ence in a positive manner has been the structuring of residence 
hall arrangements to group students on the basis of common 
elements. For example, in a number of studicii, honor students 
have been grouped together (DeCoster, 1966, 1968; Duncan & 
Stoner, 1977). The grouped students showed some advantage in 
grade point average over control groups of honors students not 
assigned to group arrangements, but differences were signifi- 
cant only during some of the semesters in which the study was 
conducted. The grouping of students in residence halls by aca- 
demic major (Snead & Caple, 1971; Taylor & Hanson, 1971) re- 
sulted in higher than predicted CPA for students in the first 
study and superiority over noaassigned students in the rccond 
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Blimling and Hample (1979) evaluated the grouping of 
students on a more simple common element, the request for a 
more structured study environment. In this study, certain floors 
were designated as study floors and specific study hours were 
set during which study was optional, but quiet was required. 
Students who violated the quiet hours policy over .in estab- 
lished limit were transferred to nonstudy floors. Students on 
study floors received higher grades; analysis indicated that the 
structured environment contributed about 0.05 points to quar- 
ter grades and about 0.02 to 0.03 points to cumulative grades. 
These differences were found to be significant in three of the 
six college quarters in which the data were collected. The au- 
thors regarded these results as an indication that even average 
students who want to improve their stud\ can profit from a 
structured environment. Although causes cannot be completely 
known, the authors considered the plan's incorporation of pos- 
itive peer influence to be a contributing factor to its success. 

Though far from conclusive, research to date would in- 
dicate that the advice of study skills texts for students to study 
away from their peeri (or family) may be more helpful than ad- 
vice that students confine study to one or two places reserved 
solely for that activity Literature on tutoring as a means of ex- 
erting a positive influence on students indicates that peer tutor- 
ing or modeling can effect some positive changes in stud)' 
behavior; the extent to which such efforts may improve grade 
point avenge was less clean Attempts to formalize coUabonitive 
study (a procedure students sometimes use on their own) 
within a classroom setting by assigning pairs of students to 
study together resulted in higher grades for paired students, but 
the difference was usually of marginal statistical significance. As 
noted earlier, students did not totally accept the procedurt* cit- 
ing concerns over being affected by someone else's work, dis^ 
satisfaction with being assigned to rather than choosing a stud) 
partner, and difficulties in getting together to meet the time 
commitments. Residence hall groupings based on such co 
mon factors as performing well academically, having the same 
major, or expressing a choice for a more structured study envi- 
ronment show potential benefits for grade point average. 
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Music and study effectiveness. Whether music interferes 
with study effectiveness is an issue of long standing. Tradition- 
ally, study skills text authors and college skills instructors have 
considered music a distraction and have advised studying with- 
out music or TV playing in tne background. Because of the 
problems involved in directly observing studying in natural situ- 
ations, the most relevant investigations into the music and 
studying issue have been those that deal with the effect of mu- 
sic on various cognitive and perceptual performance tasks. 

Some studies have indicated that music detracts from 
task perfomiance-, others that music is a neutral factor; others 
that its effects are mixed, and siiH others that music boosts per- 
formance. When reviews of such studies have been included in 
study skills texts, the investigations are usually described 
briefly, without mention of the age or grade level of the stu- 
dents. We found 1 1 Studies that met the two criteria established 
for inclusion in this review, undergraduate college student pop- 
ulations and tasks of a primarily cognitive nature. In 8 of these 
1 1 studies, authors included no-music control groups in their 
investigations, allowing for an exananation of evidence perti- 
nent to the broader question; Is music a distraction, a neutral 
factor, a mixed factor, or a facilitator when it comes to college 
students* task performance? Three of the studies indicated that 
music had no significant effect (Smith & Morris, \9^6, Wolf & 
Wciner, 1972; Wolfe, 1983). In three instances results were 
mixed, mdicating difierences related to music or student/music 
variables (Eiaugh & Ptasnik, 1982; Frceburne & Fleischer, 1952, 
Henderson, Crews, & Barlow, 1945). One study indicated per- 
formance superiority f' r the nusic listening group (Blanv hard. 
1979). In just one study (Fendrick, 1973) was music found to be 
detrimental to task performance for all participating students. 

These mixod results can perhaps be better understood 
b\ considering the many different vj'-ialples involved in each 
study Tasks, for example, varied from >tucly to study. Out of the 
1 1 studies included in this review, C involved readmg compre- 
hension or other reading tasks (Etaugh & Michals. 19":'5, Ktaugh 
& Ptasnik, 1982; Fendrick. 1973; Frceburn & Fleischer, 1952; 
Henderson, Crews & Barlow, 1945; Hilliard & Tolin. 19''9). 
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Two studies involved taking regular course examinations 
(Blanchard, 1979; Sroirh & Morris, 1976), and two others in- 
volved simple mathematical u^<$ (Wolf & Weiner, 1972; Wolfe, 
1983). In the remaining study (Belsham & Harman, 1977), stu- 
dents examined a photo using a printed questionnaire and 
then completed a recall task on photo details. 

Studies also varied in number of students involved, pro- 
portion of male and female students, length of the csting per- 
iod, and types of questions asked (beyond the broad question 
concerning the overall effect of music on perfontiance). The 
questions asked fell into three categories: Does type of music 
(classical, jazz, rock and roll) make a difference? Do student fac- 
tors related to music (student preferences, familiarity with mu- 
sic, frequency of listening) affect results? Does the volume of 
music matter, and is music different from other noises 
(speeches, industrial noise) in its effect on performance? 

Three studies explored the effect of classical versus other 
types of music. Blanchard (1979) found that students listening 
to rock and roll, jazz, or classical music during an extended 
course examination performed better than students who did 
not listen to music during the exam. No differences were found 
between the experimental groups. In addition, when blood 
pressure and pulse rates (which were taken before, during, and 
aftei the test; were compared, experimental group students re- 
turned to pretest levels faster than did control group students. 
No significant differences among the groups were found on the 
r.:ading comprehension task, however, the group listening to 
jazz read faster. 

Henderson, Crews, and Barlow (1945) compared the ef- 
fects of classical and popular music and quiet conditions. They 
found no significant differences on the vocabulary section of 
the Nelson-Denny Reading Test (Nelson, Denny, & Brown, 
1938), but popular music senc * as a distraction on the compre- 
hension portion of the test. The authors indicated that the task 
difficulty of the comprehension test could have been a factor. It 
should be noted that all of the students in this sample were fe- 
male, also, although it was not specifically stated, it appears 
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from the titles that the classical music was purely instrument:il 
while the popular music vocal. 

T\vo other factors concerning type of music were ad- 
dressed In the literature: the effectc of vocal versus nonvocal 
music and the effects of stimulative versus sedative music. 
Belsham and Harman (1977), tefUng the relative distractive- 
ness of vocal and nonvocal music, found vocal music to be 
more distiacting. They concluded that investigators should 
designate whether vocal or nonvocal music is used in experi- 
ments. The authors \. ho compared the relative effects of stimu- 
lative and sedative music (classified on the basis of an existing 
scale) were primarily interested in how snusic affected emotion- 
ality and worry during a course examination. The stimulative 
music tended to keep emotion and worry levels up, as indicated 
by student reports at inter\'als throughout the exam, but the 
type of music played durin^} various sections of the test had no 
apparent effect on exam performance. 

Variables tested relating to both the student and the mu- 
sic included student experience in listening to music and stu- 
dent familiarity with the music played. The frequency with 
v/hich students listened to music was examined in two studies. 
Etaugh and Michals (1975) found males to be less distracted 
than females by music of their preference; however, a question- 
naire indicated that the males in the sample listened to music 
more frequently than the females. When that variable was ii - 
eluded in the analysis, it appeared that the difference in distrac- 
tion level should be attributed to frequency of listening rather 
than primarily to sex differences. Etaugh and Pt:isnik (1982) fur- 
ther tested for this variable with a balanced sample of males and 
females and found that students who listened to music fre- 
quently wjrre not distracted (according to their performance) 
during a reading comprehension task; however, siudents who 
reported that they infrequently listened to music while reading 
performed significantly becu-- in the quiet condition. Hilliard 
and Tolin (1979) tested whether familiarity with the music af- 
fected student performance. They found that students who had 
heard the music in a pretest session performed better while 
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completing a section of the Sequential Test of Educational Prog- 
ress (1969) than did students who listened to unfamiliar music. 

Wolf (1983) tested the relative effects of the same music 
played at three different volumes: 60-70 decibels, 70-80 deci- 
bels, and 80-90 decibels. No differences were found in students' 
ability to solve simple arithmetic problems, but a student ques- 
tionnaire administered after the test indicated that a majority of 
the students who listened to the loudest music found it both 
annoying and distracting; this was not true for the other two 
loudness conditions. Wolf and Weiner (1972) corupared stu- 
dents' ability to solve simple arithmetic problems in a quiet 
condition, while listening to a speech recorded from television, 
while listening to industrial noise (a recording of a buzz saw), 
and while listening to rock and roll music. Students who lis- 
tened to rock and roll performed significantly better than stu- 
dents who heard the buzz saw. No significant differences were 
found among the other groups. 

These studies, all of which involved college undergradu- 
ate students in primarily cognitive tasks, do not lend support to 
the inflexible position taken by .any authors of study skills 
texts that music is universally distracting to the performance of 
intellectual tasks. Assuming these results transfer to more natu- 
ral study tasks, study skills authors would be better able to jus- 
tify discussing the various variables that may make listening to 
mvic during study distracting and then encouraging students 
to make their own decisions. 

Research indicates several factors that may affect how 
distracting music is. The two studies tliat investigated frequency 
of listening to music indicated that students who listened to 
music infrequently found music distracting when they were 
reading or studying, while students who listened to music fre- 
quently did not. Findings from one direct and one indirect 
study indicate that vocal music may be more distracting than 
nonvocal music, presumably because words are more apt to 
catch the conscious attention of the person reading or studying. 
In a study investigating the role of familiar and unfamiliar music 
on cognitive task performance, students were less distracted 
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when music was familiar than when it was unfamiliar. Although 
music volume did not affect performance in the one study that 
investigated this factor, the fact that students cited loud music 
as annoying and potentially distracting is worth considering. Fi- 
nally, the study that investigated the effects of music versus 
other noises found that music was less distracting than indus- 
trial noise. While absolute conclusions are not warranted, the 
results of these studies indicate that music may indeed be a non- 
distracting background factor for many students in some read- 
ing/study situations. 

implications 

An analysis of the literature pertinent to the study envi- 
ronment raises questions concerning some of the advice given 
by study skills texts, and possibly by study skills instructors as 
well. Other suggestions found more support in the literature. 
With reference to smdent control of study environment, the 
available literature on stimulus control did not support the sug- 
gested practice of studying totally or mainly in one, or at most 
two, places and reserving those areas for study only. The prac- 
tice did not seem to contribute substantially to improved study 
or academic success, and students resisted such contrived con- 
trol over their study environment as being too unnai ' ' The 
findings did support the advice of some texts to study away 
from friends or family, as well as the idea of planning schedules 
with specific times designated for studying. 

With reference to music and studying, a review of all 
studies in which college students comprised the populations 
did not lend support to an unqualified statement that listening 
to music while studying interferes with the learning process. 
While the finding that students who lisr^n to music frequendy 
arc less distraaed by music than those who do not lends sup- 
port to the theory that unfamiliar noises are more distracting 
than familiar ones, it also seems to suggest that some students 
require a greater degree of quiet than do others. Research seems 
to support the suggestion that students should monitor their 
distractions by writing down times when their thoughts were 
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interrupted and then analyzing tiie results "'t making neces- 
sary changes. Research also supports the notion that students 
should choose and use music so that it stays in the background, 
not com'^'^nding their conscious attention. On this basis, sup- 
port coula oe given for listening to familiar instrumental music 
while studying, and for keeping the music at a reasonable vol- 
ume. 

Attention must be drawn to a major problem that has im- 
peded research in the area of study environment. Ideally, con- 
clusions about students' ady behavior should be based on 
substantive observations of students studying in their natural 
settings. However, possibly because such observation would 
contaminate the naturalness of the environment, this has not 
been the usual practice. Therefore, many of the findings re- 
ported were based on performance of cognitive tasks of varying 
natures. Even within the group of tasks involving reading com- 
prehension, variance in task could cause variance in perform- 
ance. For example, completing a standardized test in which the 
reading material is always before the student does not require 
precisely the same skills as reading something and taking a test 
afterward; neither task is completely analogous to study Also, 
more attention to characteristics that may affect the findings, 
such as volume and type of music, would be helpful. 

The possibility of maximizing the positive aspects of 
peer influence through such practices as peer tutoring or collab- 
orative study shows some promise for research and practice for 
college reading instruction. Students who are well trained in 
study skills strategies and management may be able to help oth- 
ers, especially in improving study habits and behaviors. When 
students were required to study together, course examination 
grades showed at least marginal improvement, although stu- 
dents often objected to such practices as averaging their grades 
with those of their study partner or requiring them to study 
with assigned partners. Students who want to study with oth- 
ers may profit from study skills training in this area; this possi- 
bility merits further investigation. 
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Finally, it should be noted that since study environment 
is so closely related to such other study variables as time man- 
agement, memory and concentration, knowledge of learning 
strategies, and motivation and interest, research that involves 
several of these variables might be more profitable than studies 
relating strictly to an isolated aspect of study environment. 
Also, investigations of such self-control measures as self- 
aionitoring and problem solving are needed. Controlling varia- 
bles in the study environment to accommodate individual 
learning preferences and promote maximum learning from a 
study situation may be a key ekment of success for college stu- 
dents with at least minimal motivation, academic competency, 
and learning skills. 

Library Use 

The library is a major resource and service agency for 
both students and faculty. Those who use the library wisely 
find It offers a diversified knowledge base that can extend learn- 
ing experiences. For some, it provides a way to access informa- 
tion quickly and efficiently; for others, it is a place that is more 
perplexing than helpfiil and therefore becomes a study hall or 
reading room (Moran, 1984). Lyle (1963) reported that 50 per- 
cent of all students using libraries in a university setting were 
using their own textbooks exclusively, compared with l6 per- 
cent who were using the varied library materials for indepen- 
dent study. 

Rather than using the library as a study hall, students 
need to leam how to use it as a resource to help in their study- 
ing. The former tendency may result from students not know- 
ing how to use library aids (e.g., card catalog, indexes) to access 
information in general, or it may result from students' liinited 
prior knowk^lge of information relevant to their acaderaic goal 
(Alvarez et al., 1984). The latter would . idicate that students 
may be less certain about what information needs to be re- 
trieved from the library than about how it can be accessed, Of- 
ten students are more focused on writing the assigned papers 
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than on the process of collecting appropriate information for 
those pupers. 

In our review of study skills texts and the related litera- 
ture, we found disparate ideas. First, only 33 percent of the au- 
thors we reviewed provide information about library use. These 
authors limit their suggestions to how students can use refer- 
ence tools to obtain material in the library. Our review of the 
literature relating to library use by college students addresses a 
broader issue. We present information on how the library is cur- 
rently used and technological advances that will change the 
learning needs of college students in their use of the library. 
This information could provide direction for expanding discus- 
sions on library use by both authors of study skills texts and 
instructors of study skills classes. 

SuggesHons from Study Skills Texts 

Some authors of study skills textbooks provide exercises 
that are designed to give students practice in finding informa- 
tion (joffe, 1982; Postman, Keckler, & Schneckner, 1985; 
Shepherd, 1987). Often these exercises require students to use 
reference materials such as card catalogs, indexes, abstracts, 
government documents, newspapers, and encyclopedias to 
find information on specific topics. Typically, these topics are 
chosen without considcrailon of students* interests, assign- 
ments for other courses, or long term projects. For these exer- 
cises, the search for materials often becomes the goal rather 
than a means of *icco*nplibhing the broader goals of finding and 
integrating information across sources. 

Related Literature 

An important consideration in this review is why stu- 
dents may be having difficulty when given library assignments. 
Students* limited prior knowledge of the library, narrow topic 
assignments, and limited preparation for assignments are some 
of the factors that contribute to students' inability to use the 
library effectively. We have organized the relevant literature as 
follows, students' use of the library, instructors' expectations, 
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distinction between library and research skills, students' prepa- 
ration, and d;4iabases and workstations. 

Studkitits* tise of the library. According to Sellen and Ji- 
rouch (1984), students seem to prefer textbooks, encyclope- 
dias, or dictionaries when gathering information for a report. 
Students make minimum use of varied library reference sources 
unless compelled by the assignment. The college students in 
this study tended to rely on high school library skills such as use 
of encyclopedias. They seemed to lack both the knowledge and 
the skills needed .to access and use other sources. College jun- 
iors and seniors performed much the same as freshmen and 
sophomores in their general use of library sources. 

Even when students have libraries in their re:idence 
halls, there is evidence that they don't make full use of the avail- 
able resources. Oltmans and Schuh (1985) found that students 
prioritized their use of residence hall libraries as follows, first, 
for current periodicals an^ leisure reading, second, for class- 
related materials; third, for listening to records and tapes; 
and fourth, for reviewing art prints. Given the findings of Scllen 
and Jirouch (1984), it is not surprising that these -^uthors also 
describe a limited scope in students' use of library materials. 

Instructors' expectations. Faculty may have different 
perceptions of students' ability and use of library resources. In- 
structors who are unaware of students' lack of library skills may 
give directives their students don't understand (e.g., **U^e the 
library for this assignment"). Facility members responding to 
Sellen & Jirouch's (1984) questionnaire all said they preferred 
students to use a wide variety of resources (periodicals, in- 
dexes, abstracts) when writing papors and for class preparation. 
Instructors in natu^-al science and engineering favored use of in- 
dexes and abstracts more heavily than their colleagues in other 
disciplines, but that was the only major difference in prefer- 
ence. Sellen & Jirouch further indicated that faculty from 
most disciplines expected students to use periodicals that re- 
flect both a historical and a current perspective rather than just 
current periodicals, and regarded encyclopedias and dictio- 
naries as inappropriate sources of information. 
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Library assignments need to be carefully planned if they 
arc to be effective in developing students' use of the library. In- 
structors need to become knowledgeable about their library's 
collection and to alert students to the library services available 
to them. In a study conducted by Hofman (1981), instructors 
were found to have limited knowledge of their library's collec- 
tions, services, and materials. Despite information sources such 
as library study guides, self-guided tape tours, and student 
handbooks, instructors often sent students to the library with 
course assignmen:s requiring them to use reference materials 
not in the collection. Assignments that don't provide students 
with information about how to use the library effectively can 
lead to student frustration and poor performance. 

Getting students to use the library involves more than 
giving simple assignments without course-related relevance and 
putting books on the library reserve list. It demands a coopera- 
tive endeavor between faculty and librarians (Barnes, 1988; 
Carlson & Miller, 1984;Gwinn, 1978; Lyle, 1963; Morris, 1980) 
to help students learn lo choose appropriate reference materi- 
als. 

Distinction between library and research skills. Con- 
fused use of the terms library skills and research skills— often 
used interchangeably in study skills texts— may create further 
( jsparity between instructors' expectations and students' per- 
formance in the library. Stoan (1984), acknowledging the im- 
portance of distinguishing these two terms for students, 
defined research skills as those needed to search for knowledge 
and library skills as those needed to search for information. 
More specifically, he described research skills as encompassing 
in-depth knowledge about a specific subject area, knowledge of 
research methods associated with the discipline, the ability co 
gather and test primary data (which usually com.e from outside 
the library), and the ability to think in a particular subject area. 
Stoan described library skills as a set of mechanical skills that 
are generic across disciplines. The authors of study skills texts 
seem to focus on enhancing library skills rather than research 
skills. 
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While undergraduate students are not expected to use 
the same research skills as experienced researchers, our review 
of the literature suggests that authors of study skills texts could 
rely on the strategies used by researchers to broaden students' 
use of library resources. Both Rambler (1982) and Stoan (1984) 
acknowledge that research methodology evolves from a well- 
developed knowledge base of a subject area and that students' 
ability to integrate information across courses is a process that 
begins at the undergraduate level and proceeds through gradu- 
ate study Undergraduate education focuses primarily on ac- 
quainting students with the basic knowledge of a discipline anJ 
on teaching them how to search independently for related in- 
formation through use of texts, reserve book lists, and relevant 
additional readings. 

Alerting students to informal methods used by research- 
ers to obtain information may be useful. Studies conducted at 
Bath University of Technology (1971), and by Hernon (1982), 
McBride and Stenstrom (198^^ ^981), Stenstrom and McBride 
(1979), Van Styvendael (1977), and Wood and Bower (1969) in- 
dicate that footnotes, personal recommendations from 
scholars, personal bibliographic files, serendipitous discovery, 
browsing, and similar methods that involve no formal use of 
indexes or abstracts account for the great majority of citations 
obtained by scholars. Foi instance, 94 percent of the research- 
ers who responded to a questionnaire at bath University of 
Technology said that references in books and periodicals were 
useful to them in locating materials for research. In contrast, 
fewer than 15 percent of respondents used indexes or ab- 
stracts—a finding consistent with those of a study with college 
faculty conducted by Stenstrom and McBride. These authors re- 
ported that faculty relied primarily on footnotes in journals and 
books as sources for additional references. In a later study with 
psychology and educational psychology faculty, McBride and 
Stenstrom reported that fewer than 20 percent of either group 
made even minimal use of abstracts or references in periodicals 
or bibliographies to identify sources. The informal reference 
sources favored by these scholars are easily accessible and un- 
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derstood, and may thus be good resources for undergraduate 
students. 

Students' pi-eparation. Some investigators have found 
that community college libraries do not recognize the special 
needs of their students with academic problems (Breivik, 
1977a; Shaughnessy, 1975; Truett, 1983); thus, u - students 
who need library skills the most appear to be receiving the least 
amount of instruction (Lolly & Watkins, 1979). If we expect stu- 
dents with academic problems to use both librar)^ and basic re- 
search reference tools, we need to help them learn how to use 
these tools. Lolly ai:d Watkins (1979) note that although com- 
munity colleges require academic courses at the developmental 
level, they do little to prepare students to use library resources, 
Truett (1983) found that although more than 90 percent of the 
colleges sur\^eyed offered a developmental education program 
for their students, fewer than 28 percent of the colleges had 
library services to support these programs. For example, only 
one community college library reported having a bilingual 
handbook written in English and Spanish, even though most of 
the coUegris sur\^eyed were in cities with an above average His- 
panic population. Instruction in library use was also found lack- 
ing. The type of instruction most prevalent in the surveyed 
communit) colleges was the traditional orientiition lecture tour 
Truea described this instruction as the least effective method of 
helping students use the library b' , Mt included no course- 
related instruction. 

Bibliographic instruction (instruction in how to use cata- 
logs to search for chapter titles) is better received and under- 
stood when it is related to the research needs of specific courses 
(Carlson & Miller, 1984). In one investigation, course-related 
library instruction conducted with developmental students 
resulted in academic gains as measured by reading comprehen- 
sion tests and student-written term papers (Breivik, I9"'7a). The 
effectiveness of integrating coursework and related library in- 
struction has been supported by several other investigations 
(Breivik, 1^77b, 1987; Wagner, 1973). 

Josey (1971) suggests that varied library services should 
be made available to students with academic problems. These 
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services should include special library counseling, instruction 
specific to course assignments, and selective dissemination of 
information utilizing honors students and service-oriented vol- 
unteer groups. 

Databases and workstations. Libraries are in transition 
from manual to electronic systems (Henry et al., 1988; Moran, 
1984), but this technological advance is not acknowledged by 
most authors of study skills tests. Computerized systems have 
made interlibrary loans, librar)' acquisitions, searches for refer 
ences, and circulation m.uch easier. Even notetaking changed 
with the availability of photocopying machines in the library. 
Authors of study skills texts need to include such information 
to improve college students' use of the library's technological 
resources. 

Perhaps the first direct experience students and faculty 
will have with computerized library systems is with the librar>''s 
card catalog system. Online catalog systems arc beginning to re- 
place the 3 X 5 card catalogs used in most ac?Jemic libraries. 
These computerized systems provide the user with a fast 
method of accessing all of the library's holdings. 

Using a computer terminal to interacr. with the database 
of catalog information, students can send and receive messages 
instantaneously, requesting subject information as well as titles 
or authors of books, journals, and documents. Searching Tor 
references oo computer can save hours over a maninrt 
search. 

Other icchnological advances are in the works. Morgan 
(1984) states that library loans in the future will be accessed 
through such methods as digital telefacsimile for the delivery of 
documents. Already, libraries are linked through computer net- 
works. According to Moran, more than 2,000 library databases 
or computerized information files are available, and these arc 
increasing at a rate of 20 to 30 percent a year Some of these 
databases include the Washirigton Library Network (wln). On- 
line Computer Library Center (OCLC), Research Library Informa- 
tion Network (RLIN), and Bibliographic Retrieval Service (brs). 
Some bibliographic databases, such as brs, have introduced an 
"Afterdark" service to encourage individuals who have a pcr- 
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sonal computer, modem, and phone to access and use these 
files in the evening hours. Special evening rates for database ac- 
cess, as well as menu-driven software packages, arc available to 
further encourage use of these services (Rice, 1985). 

Databases arc being considered as viable altern-^tives for 
reducing the escalating costs of librar}' acquisitions. Stueart 
(1982) reports that an experimental plan called Adonis ha^ been 
developed by several periodical publishers to issue 10 to 15 
journals in an electronic format. According to Stueart, this type 
of format is evolving to accommodate the increasing number of 
periodicals produced each year. Library subscriptions have in- 
creased dramatically because of the burgeoning number of jour- 
nals available, resulting in higher expenses. Libraries may be 
forced to reduce their ownership of journals or other materials 
in favor of information available on databases. Stueart has 
warned that libraries' increased reliance on electronically trans- 
mitted publications may limit access to information by those 
students who are unfamiliar with electronic information re- 
trieval. Clearly, study skills texts must address this area. 

Another area that authors of study skills texts do not ad- 
dress is the use of outside workstations to access library re- 
sources. In the near future, scholars anJ student researchers 
may have library reference tools available to them at special 
workstations located in dorms or classroom buildings, which 
will preclude the need to go to the librar}'- Ohio State Univer- 
sity, for example, has a Telephone Center where students can 
check the location and a\ailability of a book or journal in the 
librar}''s collection, have it charged out to them, and even have 
it mailed to their offices or dormiior}* rooms (Lawrence, 1980). 

Other universities are preparing their physical facilities 
to deal with accessing databases directl) by creating worksta- 
tions for faculty and students. Tucker (1983-1984), for exam- 
ple, reports that Brown University has begun installing 10,000 
workstations across the campus to ser\'e the needs of both fac- 
ulty and students. These workstations will be able to access the 
Iibrar}''s catak g and other bibliographic and nonbibliographic 
databases. 
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Implications 

Advice offered by authors of study skills texts doc:> not 
represent a comprehensive view of the library skilU students 
may need to manage their study efforts. Exercises to practice 
the use of library resources need to be made relevant to stu- 
dents' course assignments so they can learn how to search for 
and use information from varied sources for class preparation 
and when writing papers. Also, students should be advised to 
take advantage of tutoring or orientation programs offered 
through their school library program. 

There is a difference between librarj' skills (searching for 
information) and research skills (searching for knowledge). 
Many undergraduate students are concerned only with librarj' 
skills. The need for research skills increases as students become 
more interested in and knowledgeable about a given discipline 
Authors of study skills texts and instructors of college study 
classes need to provide a comprehensive approach to their sug- 
gestions for library use. Needed are suggestions that not only 
orient students to library resources but also specifj' methods of 
conducting library research. 

Many undergraduate students do not fully utilize the li- 
brary's reference sources Lscause their knowledge is limited 
These students seem to rely on the same library reference 
sources they used in high school. Unfortunately, this narraw list 
of sources (e.g., dictionaries, encyclopedias) seems to be what 
is primarily advocated in college study skills textbook' Even 
though these authors also advocate indexes and abstracts, with- 
out specific instruction in the use of these materials, students 
from disadvantaged educational backgrounds will probably fall 
back on more familiar sources. Professors freque'^'ly hand out 
library assignments with little or no support for students who 
have limited librarj' skills. 

Authors of study skill texts should alert students to infor- 
mal methods of gathering information r one way to improve 
their library and research skills. Informa. methods (e.g., making 
use of footnotes and reference lists, keeping personal biblio- 
graphic files) may prove beneficial not only in maximizing stu- 
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dents' use of reference materials hut abo in helping them see 
the value of setting up their own index o'/ information. 

Advances in technology have affected how library infor- 
mation can be accessed. Now that databases are rcphcing card 
catalogs and printed indexes, they need to be explained by au- 
thors of study skills texts, college instructors, and librarians. 
Workstations also need to be discussed in study skills texts and 
developmental studies courses if college students with aca- 
demic problems arc going to be able ^o rely on these resources 
to help them study. 

Conclusions 

Two major conclusions can be made from our review of 
time management, study environment, an<j librar>' use. First, 
there is both pragmatic and theorctical/empirical support for 
giving students information and exercises to help ihem prepare 
to manage their study efforts. Students should be taught how to 
analyze and monitor the amount of time needed for study, how 
iO analyze and control the study environment, and how to 
make effective use of reference materials. Second, specific di- 
rectives (e.g., **Study with music but not television") com- 
monly found within study skills texts i-cceive mixed support in 
the literature. More research is needed to determine the appro- 
priateness of each of these directives and to assess how use of 
time, study environment, and librar}' resources may differ ac- 
cording to specific student and course needs. 

The following suggestions are offered for authors of 
Mudy skills texts, instructors of reading and stu^ly skills courses, 
and researchers. Study skills texts could be extended to describe 
how students can monitor their use of time and regulate factors 
such as music and peer influence that may impede their study 
efforts. These lexts should also help students establish strategies 
to correct their problems. Information and exercises related to 
library use should present course-related illustrations to help 
students transfer the use of specific librar> skills and resources 
to classes in which they are currently enrolled. Without using 
the technical language of published research, authors could 



ErIcjo 



2/ ft Risko, Alvarez, and Fairbanks 



provide a more comprehensive view of the topics they discuss 
so that students can understand the conditions and reasons for 
the advice that is given. Instructor manuals that accompany stu- 
dents* texts should include a summary of the theoretical and 
empirical research on which the text was based. 

Corresponding to these suggestions, instructors of col- 
lege reading and study skills courses should provide opportuni- 
ties for students to study and monitor (1) their use* of time 
during study, (2) the environmental factors that influence their 
study, and (3) their use of librarj' skills for course assignments. 
Class discussions and individual conffirences should be pro- 
vided to help students select and implement problem-solving 
strategies. Instructors need to be knowledgeable about the li- 
brary resources available to their students and coordinate their 
instruction with instructional programs offered through the 
library. 

Several ureas within this topic rcquirc further research. 
For instance, the amount of time needed to study effectively 
and across different tasks should be studied. Given that multiple 
factors have an impact on college students' study environ- 
ments, research is also needed to investigate the synergistic ef- 
fects of these factors on study habits. Also, investigators need to 
identif)' effective strategies for enhancing students' knowledge 
and, flexible use of library resources. 
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Victoria J. Risko 
Marilyn M. Fairbanks 
Marino C Alvarez 

College instructors, authors of college reading and 
stu^/ skills texts, and researchers suggest that the 
goal of reading and study skJlis classes is to prcpare students to 
use strategies that will boost their level of motivation and change 
the way they select, organize, and remember new knowledge. 
Adult learners and college students often fail to use effective 
study strategies either because they are insufficiently informed 
about these strategies or because they are unable to monitor the 
strategies they use Qohnston, 1985; Palmer & Goetz, 1988; Simp- 
son, 1984). In this chapter we discuss three factors— motivation, 
memory, and attention—since the goal of instruction for college 
students is to increase their control of each of these in order to 
establish effective study habits. 

For this analysis, we began with the same 64 current 
study skills texts we examined for the preceding chapter This 
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time we eliminated 40 of the 64 texts because they provided no 
substantial information about the strategic management of moti- 
vation, memory, or attention. Again, we completed a content 
analysis of the remaining texts to determine the extent to which 
each of the three target areas wa; addressed, the nature of the 
information and suggestions provided for each area, and the ex- 
tent to which authors of study skills texts cited or explicitly re- 
lated their suggestic»ns to theoretical or research literature. Each 
of the 24 texts combined information about at least one of our 
target areas. Table 1 summarizes the results of our analysis. 

As in our previous analysis, each study skills textbook 
we reviewed discussed at least one target area, and usually two 
or all three. We again found that most authors do not relate 
their suggestions explicitly to supporting literature. Instead, 
they tend to provide pragmatic reasons for theit suggestions, 
stating the;r case simply and in a generalized manner without 
reflecting on differing perspectives presented in the literature. 

In this chapter, we provide a review of ths theoretical 
and empirical literature that relates to eacli of the three target 
factors. We examine whether the suggestions in the textbooks 
under review reflect research findings and then discuss related 
literature. For the most part, we have limited our discussion to 
the literature on college-age students. For each of the target ar- 
eas, we organized our review to present: (1) a brief review ot 
what authors of the 24 study skills texts recommend. (2) a 
review of literature related to the designated fa( toi and an in- 
terpretation of the correspondence between what is recom- 
mended and what is supported or proposed in the literature, 
and (3) a discussion of the issues addressed. We conclude with 
recommendations for research and instruction. 

Motivational Variables 

In our work with college students in both voluntary and 
required study skills program settings, we ha /e found wide vari- 
ation in students* motivation to achieve academic improvement 
and success. Some students seemed eager to try new ideas or 
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adapt ideas they had tried and abandoned in the past, and were 
delighted when they received a good test grade or saved time 
with one of our suggested study strategies. Others seemed just 
as dedicated to proving that nothing we could suggest could 
possibly help them. We tried everything we could think of to 
improve students' academic motivation. What seemed to work 
the best for us was stressing college ' 'survival" skills early in the 
program and encouraging students to exert enough effort to 
achieve at least a little success. We found that with many stu- 
dents, a little success spurred desire for more success and could 
sometimes help turn abound a predisposition to failure, or at 
least help a fair student become a good or excellent student. 

In our experience, poor academic achievement in high 
school often contributes to poor study skills in college. Further, 
students who experience academic problems in college seem to 
lack clear-cut goals and to have a poor self-concej)t, often ac- 
companied by the attitude that failure is more a matter of bad 
luck than of their own efforts. Often, these students seem to 
have concluded that it is better to fail by not trying than by 
making an unsuccessful effort. Similarly, Fischer and Mandl 
(1984) and Palmer and Goetz (1988) note that poor readers 
who have trouble with comprehension are more likely to be 
predisposed toward expecting failure and to "react affectively 
rather than effectively" (p. 53). 

The complex relationships between motivational varia- 
bles and study behaviors have been addressed by a number of 
investigators. Biggs (1979) has hypothesized that the best aca- 
demic results for a student will occur when the student b basic 
motivation and strategy match. He proposes three motivational 
modes: utility, represented by the student who is attending col- 
lege for nonacademic reasons; learning, characterized by the 
student who is truly devoted to intellectual growth; and 
achievement, descriptive of the student who places priority on 
high grades and organizes accordingly. Biggs suggests a corres- 
ponding study strategy for each mode. Other investigators 
(EntWMStle, 1981; Hattie & Watkins, 1981; Watkins, 1982; 
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Tkble 1 

Relevant Areas Addressed in Current College Study Skills Texts 





Areas ^ 
Addressed 


Rationale Provided for Suggestions 
Given/Activities Included 


Text 


Attitude/ 
Motivation 


1 

o 


Concen- 
tration 

i 


Pragmatic 


Theoretical 
Basis 

Co IcUJI 19 1 lUVJ 


Research 
Cited 
in Text 


Research 
Reference 


Annis,1983 


X 


y 

A 






Yes 


Yes 


Yes 


Bradley. 1953 






X 






No 


No 


Brooks, 1984 


X 






Ync 

Too 


Yes 


No 


No 


Gotten & PoppifK), 1982 




X 




Yes 


Yes 


Yes 


No 


Joffe, 1982 


X 
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Yes 


No 


No 


No 


Joffe, 1988 
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Yes 


No 


No 


No 


Koizow & Lehmann, 1986 
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Yes 


No 


No 


No 


McWhorten 1986a 
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Yes 


No 


Minimal 


No 
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Watkins & Hattie, 1980) have attempted to verify this theory 
ana have indicated partial support, with tlie utility factor noted 
as the least defensible. 

Half of :ne study skills texts we reviewed dealt directly 
with the problem of motivation. For example, Nist and Diehl 
(1985) call motivation one of the most important keys to suc- 
cessful learning and studying, while Walter and Siebert (1984) 
assert that motivation and learning how to study are the most 
important variables in whether students will finish college. 

The ideas and suggestions in these books that relate to 
the role of motivation in students' academic performance 
seemed to fall into four interrelated categories: 

• assuming responsibility for academic achievement or 
improvement, 

• developing positive attitudes toward self and sur- 
roundings, 

setting goals, and 

• managing stress and anxiety. 

In the review of the research literature, we found two types of 
studies pertinent to these tour groups of variables: studies in- 
vestigating the relationship of motivational variables (and 
sometimes other factors) ro academic success, and studies con- 
cerned with improving academic performance by manipulating 
motivational variables. In the discussion that follows, we exam- 
ine each of the four categories, summarizing in turn the sugges- 
tions made in study skills texts and the available empirical 
su.v/esof both types. 

Suggestions from Study Skills Texts 

Assuming responsibility. Walter & .ebert (1984) and 
McWhorter (1986a, 1986b) stress the importance of student' 
accepting total responsibility for learning and taking a positive 
rather than a passive attitude. They ^.dvise students not to ex- 
pect teachers to be entertainers whose job is to get their atten- 
tion but instead to accept an active role in finding useful 
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information available in every class. They also indicaie that be- 
ing responsible for oneself means accepting both successes and 
failures, and viewing failures as a signal for the need to change, 
Sherman (1984) advises students to gain control of their learn- 
ing by using good study skills; howevC- few authors offer sug- 
gestions for self-directed strategies students can adopt. 

Instead of simply giving advice about self-responsibility, 
at least two authors attempt to build the concept into the 
book's approach. Cohen and Poppino (1982) designed their 
book around vhat they term a Piagetian/schema or discoviir>' 
approach. For each of the skills introduced, they direct the stu- 
dent first to approach a learning problem and figure out solu- 
tions (exploration), then to state the solution as i principle or 
formula (invention), then to field test the solution (application), 
and finally to restate the problem and their decisions (recapitu- 
lation). Brooks (1984) organized his text to encourage students 
to examine and build on their background knowledge and then 
make their own study skills decisions in n motivationally ori- 
ented psycholinguistic approach. 

Developing positive attitudes. Student attitudes, which 
are firmly linked to other motivational factors, can have a pow- 
erful impact on the success of students' study habits. Walter and 
Siebert (1984) stress five major points about this topic (some of 
which other study skills authors also address). First, they try to 
impress on students the importance of believing in their ability 
to achieve academic success. This point is echoed by Sherman 
(1984) and Nist and Diehl (1985), who tell students they should 
accept their admission to college as evidence of their potential 
for academic success, but that they have to consciously supply 
the motivation to achieve. 

Second, Walter and Siebert (1984) stress the importance 
of students* belief that they are in control of their own lives. 
The authors include an attitude survey to help students deter- 
mine the extent to which they feel in control of their lives, and 
explain that students who read texts with the belief that they 
can learn and gain from them are more apt to be internally 
tether than externally oriented. Third, they emphasize the need 



ERIC 



itcrnal Factors TJiat Influence Study 2 5 S ^'^ ^ 



to avoid negative thinking and the games losers play, such as 
attributing success or failure to luck, or making excuses for not 
doing T hat they knew would bring academic success. 

Fourth Walter and Siebert (1984) as well as Wood (1986) 
advise students to replace negative thinking with positive think- 
ing, or self-Lilk. and to imagine themselves in rc\v:?xding and 
successful situations. List, the authors tell students to cultivate 
a positive approach toward academic surroundings— for in- 
stance, to expect to learn something from every lecture. 

Setting goals. As with the other motivational variables, 
goal setting is a factor students can learn to control. Walter and 
Siebert (1984) and Wood (i986) emphasize setting reasonable 
goals and then judging one s success by the extent to which 
those goals arc met. Sherman (1984) also addresses the impor- 
tance of goal setting -js a motivational strategy, viewing it as a 
way of dealing with anxiety. Both Wood (1986a, 1986b) and 
McWhorter (1986) advise students to reward themselves when 
goals are met. Further, Wood asks students lo consider the con- 
sequences of not meeting established goals. Other study skills 
texts do not address this issue in any depth. 

Managing stress and anxietyK Stress, a complex motiva- 
tional variable, often is difficult to assess and to channel pro- 
ouctively Pauk (1984) differentiates between stress and tension, 
describing stress as a bodily response to demands placed on it 
and tension as the "wrong" response. In attempting to help stu- 
dent:, deal with tension, Pauk offers four general suggestions for 
dealing with stress. (1 ) avoid stressful situations, (2) be overprc- 
pared for academic work, (3) le*:rn to rela;^ without feeling 
guilty, and (4) avoid procnistination. He lists 1 1 specific ways of 
releasing tension, including talking it out and escaping tempo- 
rarily, and recommends relaxation methods such as controlled 
breathing techniques. Sherman (1984) and Wood (1986) both 
note that some stress is natural and can even be helpful, but that 
stress sometimes becomes too great and turns into worrj- and 
nervous anxiety. Wood advises :,tudents to determine what is 
cai sing their anxiety and to set constructive ways of eliminat- 
ing or minimizing the contributing problem. 
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Related Literature 

Assuming responsibility We reviewed the literature to 
investigate possible relationships between academic perfox v 
ance and a number of facers considered closely associated 
with assuming responsibility for academic achievement. These 
factors include locus of control, students' attributions of suc- 
cess or failure, academic job involvemeni self-monitoring, sdf- 
rcinforcement, and problem solving. 

Locus of control . Locus of control refers to persona! per- 
ceptions of what accounts for the successes or failures in your 
life. This construct can be measured by the Internal/External 
Locus of Con- .ul Seal'* developed by Rotti*r U966). Individuals 
with a high internal locus of control (as measured by the scale) 
attribute their successes or failures to the consequences of their 
own actions. Conversely, individuals with a high external locus 
of control attribute their successes or failures to outside forces 
(fimiily, peers, enemies, fate). 

The notion that a high internal locus of control will cor- 
relate with high academic achie\'cment is based on the assump- 
tion that a person who belies^es that successes and failures are 
due to the results of his or her own behavior will be morc likely 
to exhibit initiative and persists v e in meeting achicvcmer: 
goals, (Rotier, 1966). Keller, Sutterer, and Gold-T.an 
however, think that evidence casts doubt on the verar'ty of tins 
assumed relationship. They cite separate reviews by Phares 
(1976) and Lefcourt (1976) in which the authors examined nu- 
merous studies, found mixed rcsults, and came to different con- 
clusions. Phares concluded that internal locus of control docs 
tend to correlate with academic performance, while Lefcourt 
concluded that the studies arc often inconsistent and contain 
odd results. 

Studies not included in these two reviews also show 
mixed results. Keller, Sutterer, and Goldman (19''8) cite three 
audies (Allen, Giat, & Cherney, 1974; Daniels & Stevens, 19"'6; 
Parent et al., 1975) investigating the relationship between per- 
ceived locus of control, course structure, and achievement in 
which students with a high external locus of control performed 
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better under highly structured conditions than those with a 
high internal locus of control. A study by Johnson and Croft 
(1975), however, found no differences in achievement attribut- 
able to locus of control or structure. Similarly, Keller et al. 
(1978) found no relationship between locus of control (as mea- 
sured by the Rotter Scale) and academic success in a study in- 
volving 463 university students. Traub (1982), also using the 
Rotter Scale, found that course grades of female freshmen cor- 
related significantly with locus of control but that course grades 
of male freshmen did not. The correlation was moderate, how- 
ever, even for females. The metaanalyses conducted by Findley 
and Cooper (1983) and Hansford and Hattie (1982)' revealed 
that students' perceptions of themselves and their control over 
learning showed consistent relationships with educational ac- 
complishments. 

Some researchers attribute the inconsistencies in the lo- 
cus of control results to differences in instruments used, the 
methods employed, or the selection of subjects. There arc also 
two conflicting theoretically based viewpoints about the causes 
of these inconsistencies. Rotter (1966), taking a social theorj' 
viewpoint, maintains that locus of control is more operational 
in novel situations. He notes that while some students may en- 
counter novel situations in their academic endeavors, most aca- 
demic situations in college are very similar to those students 
have met beforc. Therefore, he would not expect completely 
consistent results. 

The alternative viewpoint is that the inconsistencies may 
be due to a confounding factor in the locus of control concept 
itself Heider (1958) suggests consideration of four related fac- 
tors to which a behavior can be attributed, task difficuUy and 
ability (considered to be stable factors), and effort and luck 
(considered to be unstable factors). Weiner et al. (1971j main- 
lain that intemality as measured by the locus of control concept 
centers on one stable factor (ability) and one unstable factor (ef- 
fort), thus producing the inconsistencies noted in the literature. 
Weiner and others (Frieze & Weiner, 1971, McMahan, 1973; 
Weiner et al, 19"^2) ftirther maintain that the unstable factors 
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arc more closely associated with affective responses, such as 
happiness over success or despondency over failurc, whiie the 
more cognitively oriented stable factors are morc closely associ- 
ated with performance. 

In several studies designed to control the confounding 
factor, these researchers found that academic performance had 
a stronger relationship to stable factors (ability, task difficulty) 
than to unstable factors (effort, luck). These studies also indi- 
cated the expected positive relationship between locus of con- 
trol and affective responses. In a later study conducted with 
students in a psychology class, Keller, Sutterer, and Goldman 
(1978) used Rotter's scale as a locus of control measure, the Sur- 
vey of Study Habits and Attitudes Inventorj^ (ssha) (Brown & 
Holzman, 1967) as a measure of study habits and attitudes, and 
rate of progress and final grade point average as performance 
measures. All the locus of control measures were more highly 
correlated with the ssha attitude scales than with the study 
habits scales. Locus of control was not found to be a significant 
predictor of either performance measure. 

Attribution s. Some theorists Oohnston & Winograd, 
1985) and investigators (DeBoer, 1983) have extended Weiner 
et al.*s (1972) idea that "attributions" for failure or success are 
linked to academic achievement. Weiner et al. referred to attri- 
bution iheor), which describes motivations for human behav- 
ior, as the search for a causal understanding of failures. DeBoer 
devised a survey form that included the 4 factors used by Wei- 
ner as well as 7 others (quality of instruction, quality of high 
school preparation, social distractions, desire to achieve high 
grades, ability to work hard and long on difficult tasks, stand- 
ards set by the instructor, and ability to concentrate while 
studying). The suney, which was sent to 650 college freshmen, 
asked students to rate the relative importmce of the 1 1 factors 
and to predict expected course grades. Respondents were desig- 
nated "high success" students if they met or exceeded grade 
predictions and "low success" students if they did not. Those 
later designated high success students rated 8 of the 1 1 factors 
as having more of an effect on their performance than did the 
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low success students. The two groups showed no significant 
differences on their rating of the other 3 factors (quality of high 
school preparation, social distractions, and course difficulty). 
DeBoer notes that his findings are basically in agreement with 
the theory proposed by Weiner et al. (1971), and concludes that 
the association between long term expectancy and stable suc- 
cess factors does affect academic motivation. Further research 
in this area seems warranted. 

Academic job involvement .. Several investigators have 
adapted instruments developed for business ani industry to ac- 
ademic settings to measure the degree to which a job situation 
affects a student's academic success. Batlis (1978) and Edwards 
and Waters (1980) found positive relationships between aca- 
demic job involvement (i.e., students' degree of involvement in 
i^lass assignments and class situations) and course performance. 
Edwards and Waters (1982) investigated a possible relationship 
between academic job involvement and attrition in a two-year 
follow-up of 135 student 5 on whom data were gathered in iheir 
freshman year No significant relationship was found, howe\ jr 
They conclude that attrition may reflect a much w ider raiige of 
variables than does academic achievement in a particular 
course. 

Self-monitoring . Since self-monitoring strategies en- 
courage students to channel their academic achievement re- 
sponsibility to improve academic performance, and since these 
strategies have also been found to enhance motivation, they 
seem pertinent to this discus: ion. Two elements are consider^ed 
essential in self-monitoring, systematic self-observation and 
subsequent recording of these observations (Ndson, 197!", 
Richards, 1977). Self-monitoring can be applied to numerous 
situations, such as observing and recording the number of 
pages read or the amount of notes taken in studying a subject 
for a particular period of time, observ ing and recording distrac- 
tions encountered in a particular study situation, or observing 
and recording instances of success or failure in taking effective 
note5 from a lecturer (Kirschenbaum & Perri, 1982). 

Richards (1981) has directed a number of controlled 
studies investigating self-monitoriiig. He has concluded that re- 
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search results on self-monitoring indicate progress beyond the 
"promising'' stage, and that this strategy is an effective way of 
helping students improve their academic performance. Numer- 
ous controlled studies involving groups of college students sup- 
port this view (Groveman, Richards, & Caple, 1977; Richards et 
al., 1976). Tn additipn to the group successes, Richards (1981) 
reports that he and his colleagues have found self-monitoring to 
be an important discriminant of successful self-management by 
students coping with study problems on their own, citing stud- 
ies by Hefferman and Richards (1981) and Perri and Richards 
(1977) among others. He notes that two remaining concerns are 
to gain an understanding of why the procedure works and to 
determine the factors that may contribute to long term effects 
on student behavior. 

Investigators outside of the Richards group have re- 
ported mixed results in studies in which self-moaitoring— 
either alone or combined with study skills strategies such as 
stimulus control, self-reinforcement, or goal setting— was an in- 
dependent variable. In a number of studies including self- 
monitoring of such procrastination behaviors as neglecting to 
turn work in on time, delaying studying, or arriving late to 
class, self-monitoring was reported to improve both academic 
behaviors and achievement Qackson & Van Zoost, 1972; 
Kirschenbaum & Perri, 1982; Sieveking et al., 1971). However, 
other researchers (Bristol & Sloane, 1974; Green, 1982; Greiner 
& Karoly, 1976) found that self-monitoring, either alone or 
combined with study skills strategies, did not help students de- 
crease procrastination behaviors or improve graujs. 

In a study in which a variety of self-monitoring tech- 
niques were used, Johnson and White (1971) compared grade 
point averages of 97 college students in three groups: those as- 
signed to monitor their study behaviois, those who monitored 
their dating behavior, and those in ^ control group who con- 
ducted no self-monitoiing. The students who engaged in self- 
monitoring of study behaviors received higher grades than 
either of the other two groups, but only superiority over the 
control group was statistically significant. In a study conducted 
by Morgan (1981), self-monitoring of specific study behaviors 
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chosen and formulated by ihc students was effective in improv- 
ing both the target behaviors and course grades. 

Some experimental efforts have been directed toward 
determining factors that may increase the effects of self-moni- 
toring on academic behaviors and performance. Mahoney et aL 
(197'^) found that students on a continuous self-monitoring 
schedule during review for the Graduate Record Examination 
(GRE) studied longer and performed better on the exam's quan- 
titative problems than did students on an intermittent self-mon- 
itoring schedule. Richards et aL (1976), investigating the 
relationship between how much students know about their 
own study behaviors and the impact of self-monitoring, found 
that students who had the least prior information about their 
own study behaviors gained the most from using the self-moni- 
toring strategy. The number of self-monitoring methods used 
was found to be a contributing factor in a study by Mount and 
Tirrell (1977). Some theorists, such as Bandura (1982) and Mc- 
Combs(1988), suggest that to assume self management of their 
learning students need to perceive themselves as competent in 
their ability to apply appropriate cognitive and affective strate- 
gies. They note that increasing students' ability to monitor their 
brhavior while enhancing their perceptions of being in control 
of their own learning can enhan^. both motivation and 
achievement. 

Although few study skills authors advise students to self- 
monitor their study behavior, research suggests that this strat- 
egy may help improve academic performance. The relative ease 
of using the strategy, plus the fact that students have used it sue- 
ressfuUy as a self-administered technique as well as in group and 
individual counseling settings (Richards, 1981), would seem to 
warrant its inclusion in study skills texts and in college reading/ 
study skills classes. 

Self-reinforcement > Self-reinforcement, like seif-moni- 
tCiing, is a strategy that students can assume themselves. With 
this technique, students reward themselves in some way after a 
desired response (Jones, Nelson, & Kazdin, 1977; Mahoney & 
Arnkoff, 1978). In his discussion of self-control studies, 
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Richards (1981) concludes that self-reinforcement does not im- 
prove study behavior cr academic performance -^ore than self- 
monitoring alone, citing tv/o studies that specifically illustrate 
this point (Richards et al., 1976; Van Zoost & Jackson, 1974). 
Richards also contends that self-reinforcement needs careful 
handling by a counselor for students to take it seriously. 

Two other studies indicate that self-reinforcement, in 
conjunction with other self-control or related techniques, may 
enhance academic behaviors or achievement. In a study with 
96 college students. Greiner and Karoly (1976) found that stu- 
dents trained in a combination of self-reinforcement, self-moni- 
toring, planning, and study methods performed better than 
students trained in study methods alone. However, groups who 
were trained only in self-reinforcement and self-monitoring, or 
in self-monitoring alone, did not significandy outp^ form stu- 
dents trained in study methods alone. Only the sti ients trained 
in the combination of all four strategies displa)c superior per- 
formance. A later study (Green, 1982) also presented a some- 
what encouraging picture. Green evaluated the effectiveness of 
self-monitoring alone or self-monitoring plus self-reinforce- 
ment in improving procrastinar*jn behavior*^ displayed by six 
academically disadvantaged minorit) college students. Al- 
though self-reinforcement alone had no significant effect, selt 
monitoring plus self-reinforcement decreased procrastination 
and improvo I academic behaviors. 

While ncne of the studies discussed here indicates that 
seif-reiriorcement alone is an effective strateg), self-reinforce- 
ment combined with other strategies proved effective in tv^o 
out of four of them. Further research is needed to determine 
under what conditions self-reinfoi cement may improve aca 
demic behaviors and performance. 

Problem solving . Problem solving t . mportant and 
complex part of a^!>uming self-responsibility. In this section wc 
address several aspects of this issue, including theoretical views 
on the nature of the problem-solving process, steps or sis es 
involved in problem solving, factors related to successful piob- 
lem solving, traits of successful and unsuccessful problem solv - 
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ers; indications that problem solving can be learned; and the 
use of problem-solving strategies in programs designed to en- 
hance the academic behaviors and achievement of college stu- 
dents. 

Pitt (1983) ^ees problem solving as having two main the- 
oretical perspectives: an information processing model and a 
Piagetian model. Arguing that these viewpoints are comple- 
mentary rather than mutually exclusive, Pitt has created her 
own model to reconcile the two. Looking at the issue from a 
somewhat different perspective, Heppner (1978) has identified 
a range of views about the problem-solving process, varying 
from the learning approaches typified by the ^rited works of 
such investi'^ators as Gagne (1964) and Skinner (1974), to the 
traditional cognitive gestalt approaches exemplified by Koehler 
(1925) and Maier (1970), to the computer simulation and math- 
ematical models described by Newell and Simon (1972). 

Although problem solving is viewed from many different 
vantage points, there seems to be considerable agreement on 
the steps or stages involved in the problem-solving process. Pitt 
(1983) lists these five steps, which researchers seem to agree on 
almost universally. (1) recognition of the problem, (2) analysis 
of contributing factors, (3) consideration of possible solutions 
(4) choice of optimal solution, and (5) evaluation o^" feedback to 
determine results. These steps closely approxin ate the five 
problem-solving stages involved in the utility model introduced 
by D'Zurilla and Goldfried (1971). 

In an analytical review of the research on problem solv- 
ing, Heppner (1978) discusses the characteristics and research 
findings associated with each of the five stages proposed by 
D'Zurilla and Goldfrieu (1971). In the initial stage, general ori- 
entation, Heppner indicates a need to accept the existence of 
problems as a normal part of living, to accept the presence of 
particular problems, and ideally to feel competent to solve 
problems. The suggested procedures for helping someone use 
problem-solving strategies include showing short videotapes of 
people in the process of solving problems, encouraging verbal- 
ization of problems, and sharing information on successful 
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problem-solving instances. With reference to the second stage, 
referred to as problem identification and verification, Heppner 
suggests encouraging behaviors typical of good problem solv- 
ers, such as gathering information about the problem, opera- 
tionalizing vague dements, and identifying relationships among 
environmental evenis related to the problem. Hcppner's analy- 
sis of the third stage of the problem solvin^, generation of alter- 
natives, is that it is not as simple as it might seem. He notes that 
students may need help in overcoming the tendency to reduce 
the number of alternatives by exhibiting bias against certain 
possibilities or by not being creative enough to see novel solu- 
tions. Brainstorming and reorganizing ideas were strategies sug- 
gested as being helpful. 

The fourth stage, decision making, involves selecting 
one of a set of alternatives. Here Heppner (1978) reports 
D'Zurilla and Goldfried's (1971) contention that making good 
decisions entails choosing an alternative with both high proba- 
bility and high desirability, being consistent with personal 
goals, being willing to assume personal responsibility for deci- 
sions, and reaching a solution that has minimum negative as- 
pects. The fifth stage, verification and evaluation, involves 
testing the plan of action and matching the outcome of the re- 
sponse to some standard. Heppner suggests that in evaluating 
responses, individuals should use techniques such as self-moni- 
toring and self-reinforcement to encourage continuation of the 
behaviors necessary for dealing successfully with the identified 
problem. Alt.^ongh Heppner s review was not limited to college 
students or to the solving of academic problems, his analysis of 
D'Zurilla ana Goldfried s stages of problem solving can be used 
in dealing with academic and personal problems that may im- 
pede study. 

A number of investigators have examined the differences 
between effective and ineffective problem solvers. Nezu i,1985) 
administered the Problem Solving Inventory (Heppner & Peter- 
sen, 1982) — along with depression, anxiety, problem identifica- 
tion, and locus of control measures— to 213 undergraduate 
students. Self-appraised effective problem solvers repoued less 



d - 2r>8 

ERJ C ernal Factors That Influence Study 253 



hminniimrfTimia 



depression, fewer trait and state problems, and less distress asso- 
ciated with these problems than did self-appraised poor prob- 
lem solvers. These findings are consistent with those of 
Heppner, Reeder, and Larson (1983), who found that self- 
appraised effective problem solvers had better self-eoncepts, 
displayed more consistency in their self-percepuuns and were 
less critical of themselves than self-perceived ineffective prob- 
lem solvers. This study also found that effective problem solv- 
ers had fewiir dysfunctional thoughts, fewe; irrational beliefs, 
and less blameful coping styles. 

Attempts to train students to use problem-solving strate- 
gies more effectively also have been reported in the literature. 
GarPerin and Danilova (1980) reported on the effectiveness of 
training students in an analytical process that involved studying 
the problem situation in general and then the various associated 
hypotheses. They reported that 16 university students trained 
to tudy in this way replaced their tendency to collect neces- 
sary information in an unconscious and unorganized way and 
learned to make decisions intuitively with an approach that in- 
cludc^ a systematic, conscious, and well-organized analysis of 
the problem, the formulation and verification of possible solu- 
tions, and a more divergent and productive thinking process. 

Nezu and D'ZurUla (1981) investigated the effects of 
trairang students in a method of defining and formulating so- 
cially oiiented problems on their ability to choose effective so- 
lutions for such problems. This method was based on the utility 
model of decision making formulated by D'Zurilla and 
Goldfried (1971). The researchers confirmed their hypothesis 
that students trained in this decision-making method would 
make significandy better decisions about pix)blems presented 
Finally, Lochhead (1982) asserts that students can be taught to 
become effective problem solvers without being programmed 
to execute spec.fic problem-solving techniques. He offers evi- 
dence to support his system, which emphasizes training in the 
art of inventing and selecting appropriate strategies. 

Of particular relevance here are the investigatioas link- 
in^ training in problem-suiving strategies with improvement in 
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college students' academic performance In a case study of 
three college students learning genetics, Baird a;id White (1982) 
reported that increasing students' awareness of the naJure of 
the learning process and training them in procedures for en- 
hancing self-evaluation and decibion making helps them im- 
prove learning. Richards and Perri (1978) investig; '^d two 
means of prolonging the effectivenesb of self-control treatments 
intended to improve college students' academic performance: 
behavioral problem solving and faded counselor contact. The 
results indicated that training in problem solving was an effec- 
tive treatment maintenance strategy, but that brief fading of 
counselor contact was not. Huntei t al. (1982) reported on a 
successful program jailed Siress on Analytical Reasoning (soar), 
which was designed to enhance the problem-solving and aca- 
demic 'abilities of prefreshmen during a summer program. 
Stowbridge (1983) described an introductory course in com- 
puter programming that emphasized the problem-solving proc 
esses taught to college freshmen to improve their ability to learn 
other college subjects. Results indicated that the course was 
successful in improv' academic peu. rmance. 

Although more controlled research is needed on vhe use 
of problem-solving techniques for dealing w ith college stu 
dents' academic and related problems, currendy available re- 
search has shown promising results. The studies reviewed here 
indicate thai effectiveness in projlem solving is related to per 
sonality traits associated with academic success, and chat prob- 
lem-solving strategies can help college students improve 
academic performance. 

Our review of the literature related to locus of control, 
attributions, and academic job involvement suggests that more 
research in these areas is needed before specific recommenda- 
tions can be made to authors of study skills texts. It does seem 
appropriate, however, to recommend that such authors could 
elaborate on their general advice for developing positive atti- 
tudes by helping students identify situations in which success 
has been attained (e.g., graduating from high school, being ac- 
cepted to college). Building such a recognized history of suc- 
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cess may contribute to the stability of students' academic 
expectations and motivation. 

In this section we reviewed three strategies for assuming 
responsibility for academic achievement; self-monitoring, self- 
reinforcement, and problem solving. These techniques, along 
with stimulus conttx)l (discussed in Chapter 5 of this volume), 
have been used to motivate college students to put suggested 
study strategies into actual practice. These techniques have also 
been used to help college students change behaviors that inter- 
fete with academic progress and success. Self-monitoring has 
been med with some success both in group counseling sessions 
and in self-help situations in which students were given hand- 
outs describing its use. While self-monitoring and problem 
solving have been successful in programs in which they were 
the sole behavioral component, self-reinforcement has shown 
success only in combination with other behavioral strategies. 
Tailoring combinations of behavioral strategies to suit the needs 
of individual students ma> be especially effective in motivating 
students to apply study strategies or to overcome interfering 
habits. Although, as Richards (1981) notes, it is difficult to get 
students to continue using learned behaviors that enhance aca- 
demic success, problem solving has shown some promise as a 
maintenance strategy. 

In view of these findings, including more of these strate- 
gics in study skills texts wou\d seem wau^anted. Also, their care- 
ful implementation into college reading and study skills 
programs seems justified. 

Developing positive attuudes. Several researc»^ers have 
found positive relationships between general achievement in 
college and self-concept (Bailey, 1971, DeLisle, 1953; Griffore 
& Samuels, 1978; Simpson & Boyle, 1975). However, other in- 
vestigators have failed to find a significant relationship (Badgett, 
1968; Boshier & Hamic, I968; Iglinsky & Wiant, 1971). 
Badgett, iiope, and Kerlej' (1971) investigated the possibility 
that self-concept ma> be more positively related to some aca- 
demic areas than to others. They found a positive relationship 
between self-concept and academic aptitude among students in 
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the colleges of architecture, liberal arts, and sciences, but an in- 
verse relationship among students in the colleges of agriculture, 
business, engineering, and veterinary medicine. In a more re- 
cent stPdy, Robinson and Cooper (1984) found a positive rela- 
tionship between self-concept and academic success among 
freshmen pursuing technological careers. 

A number of methods have been used in an attempt to 
change attitudes and increase student motivation witn the hope 
of improving academic performance. We review selected treat- 
ment studies associated with two methods: exi insic rewards 
and contingency contracting. 

Extrinsic rewards . Bebeau and Sullivan (1982) con- 
ducted a study to determine university education juniors' pref- 
erence for various academic incentives. Their results showed 
that release from final exams and positive comments from the 
instructor were the preferred incentives. Jackson and Van Zoost 
(1972) randomly assigned 4? university freshmen to a self- 
administered reinforcement group, an external reinforcement 
group, or to one of two control groups. Both treatment groups 
were given the opportunity to earn back a S 10 deposit they had 
made. Both types of reinforcement were found to benefit study 
habits, but neither produced a significant gain in academic per- 
formance. 

Interrelationships bct^veen various types of extrinsic 
motivation and instructor variables have also been examined. 
For example. Marsh (1984) conducted a study in which 4 16 col- 
lege students viewed one of several videot:iped lectures and 
then completed an objective examination based on the lecture 
The lectures vaiied in the amount of test content covered and 
the degree of lectui'er expressiveness. Some groups were told 
before the lecture that they would receive money for correct 
responses (incentive to learn and perform), some were given 
this information aftei the lecture (incentive to perform), and 
others were not given an incentive. Marsh found that better stu- 
dent performance was r.ssociated with incentives, content cov- 
erage, and lecturer expressiveness, although the effects of 
instructor expressi\'eness varied with the incentives. When no 



ERIC 



272 

iternal Factors That Influence Study 257 



outside incentive was giv^n, the effects of lecture expressive- 
ness were significant; however, when extrinsic motivation was 
provided, instructor expressiveness had no significant effect. 
Perr>^ and Dickens (1984) found similar results in a separate 
study. Overall, the findings of these studies suggest that extrin- 
sic rewards can enhance academic performance, particularly 
when associated with other forms of reinforcement. 

Contingency contracting . In a study in which some stu- 
dents had short term contracts for curriculum mastery, some 
had long term contracts, and some none at all students operat- 
ing with contracts had higher final exam scores than students in 
the self-paced groups (Brooke & Ruthven, 1984). Changes in 
study habits and altitudes also tended to favor contract group 
students. 

Since the enrollment of college students with academic 
problems in study skills or related courses is not voluntary, and 
since the nature of the relationship between locus of control 
and academic achievement is far from clear, study skills instruc- 
tors must work with students whose attitudes varj'«widely. As 
Paris, Lipson, and Wixson (1983) note, students' independent 
learning is often a combination of both skill and will" (p. 305)^ 
Therefore, extrinsic reinforcement i^r.J contingency contract- 
ing strateg'cs seem worth consideration by authors of study 
skills texts and college instructors. Further research and analysis 
are warranted. 

Setting goals. Supporters of the expectancy theor)', as 
postulated by Vroom (1964, 1965) and later modified by oth- 
ers, argue that an individuals short term goalb affect perform- 
ance and are related to long term goals. Malloch and Michael 
(1981) state that self-efficacy (expectancy) may provide a simple 
method of meu ing and quantifying motivation and thus may 
also prove useful in predicting academic success. In a study 
conducted by these two investigators, 71 college students were 
asked to predict their grade point average for a particular se- 
mester (considered a short term goal). The> were also asked to 
indicate the relative importance to them of s-jch alternative 
long term goals as material success and lasting fuendships. The 



ERIG 



273 

Risko, Fairbanks, and Alvarez 



researchers concluded that the expectancy (short term goal) 
measure contributed more to the pr<idictnoility of CPA than an 
ability measure (Amcpcan College Testing assessment) alone. 

In a study designed to investigate the congruence of self- 
eff.cacy and locus of control Minor and Roberts (1984) asked 
students to predict their ability to solve anagrams. When direc- 
tions for the task were given, sdne subjects wene told that their 
ability to solve the problems would depend on their verbal abil- 
ity (skill directions), while others w^erc told that verbal ability 
would not be a determining factor (chance directions). The re- 
searchers reasoned that internally oriented students would per- 
form better with skill directions and externally orier i 
students with chance directions. No significant differences 
were found, but the order of results was as expected. 

A number of studies have investigated ihe relationships 
an»ong factors pertinent to career goals, academic motivation, 
and performance. Chase and Keene (1981) found a positive re- 
lationship between tin of declaration of major and academic 
perforiHance. Students who declared their 'ors early tended 
to achieve at a Iiigher level than their 2v emic indicators 
(Scholastic Aptitude Test and high school grades) would have 
predicted. On the other hand, students who delayed their dec- 
laration of major beyond the second year of college tended to 
achieve below their predicted levels. Super (1977) postulated 
that students are more likely to succeed in college if they ex- 
plore career choices, if they have fac''ity <n decision making, if 
they seek occupational direction congruent with their mtcrests, 
and if they estimate their interests accurately. And according to 
Altmaier, Rapaport, und Seeman (1983), probationarj students 
listed uncertainty over career goals as one of the major factors 
interfering with their academic perfomiance. 

Using recently developed measures of career maturit}, 
Healy et al. (1984) investigated the relationship between caieer 
indicators and college grade point averages for two groups of 
students. 1 82 community college students taking eithci a health 
science or a psychology course, and 126 freshmen in ; n aca- 
demic advancement program for disad\antaged students, btu 
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dents' perceptions of their decision-making abilities correlated 
significantly with gpa for both groups of students. The authors 
pointed out that it was impossible to determine the extent to 
which basic motivation to achieve in college affected career in- 
dicators, or vice versa, but they noted that students might well 
profit from attempts to move forward on their career-setting 
goals and other aspects of career maturity. 

A somewhat more generalized goal-related factor is goal 
instability, defined as a lack of the mature, self-directed system 
of values and goals that guide individuals toward accomplish- 
ments and self-expression (Scott & Robbins, 19«5). These inves- 
tigators found a moderate correlation between goal instability 
scores and several measures of academic achievement in a study 
involving 72 undergraduate students enrolled in learnmg .skills 
classes. 

\ lie positive influence of setting relevant goals on :he 
performance of a task has been well documented in the litera- 
ture, as indicated in an extensive review spanning the period 
from 1969 to 1980 (Locke et al.. 1981). The authors found that 
the beneficial effects of goal setting on task performance was 
one of the most robust and replicable findings in the psycholog- 
ical literature. According to the autho_, these benefits accrue 
because goals direct the individuals attention to the task, mobi- 
lize energies and efforts, prom te persistence, and encourage 
the development of strategies relevant to goal attainment. Goals 
are indicated as most likely to benefit performance when they 
are challenging without being u^r.^ttainable, -jviicn they are spe- 
cific, when they are accepted or chosen by the individual, 
when their outcomes are of high value, and when the time 
needed for their attainment seems reasonable. Students often 
fail to achieve not because they lack abiliiy but because they 
don*t use goal-directed strategies efficiendy (Winograd, 1984). 

Studies u^ing goal setting with college students have 
tended to be designed either to use goal setting to improve 
course grades or to determine whether goal setting affects the 
learning of particular academically oriented tasks. Studies ex- 
amining the effeccs of goal setting on academic achievement (as 
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reflected by course performance) have varied considerably in 
experimental design and have shown mixed results. Locke and 
Bryan (1968), for example, investigated the relationship of goal 
level to academic performance by asking college students to in- 
dicate the grade point averages they hoped for, expected, and 
would try for, both in their easiest and most difficult courses. 
The researchers found that students who set difficult goals 
more often failed to meet their goals but also achieved higher- 
level course performance. 

Mercier and Ladouceur (1983) investigated the relative 
value of five different self-control treatments, including setting 
proximal goals, setting distal goals, and increasing study time, 
on improving grades. The treatment group that involved both 
self-monitoring and distal goals spent more time studying than 
either the group that used self-monitoring alone or the groups 
that received no treatment. No significant improvement was 
found in grades, however. \C'arner (1984) examined the effects 
of goal setting on test perfoimance in an education course that 
involved 16? undergraduate students. Students in the experi- 
mental group completed a "goal card" one week befcic ^ach of 
three course exams, noting their anticipated grade on the tests. 
Analysis A the data indicated no significant differences be- 
tween goal -setting conditions and task difficulty. 

Morgan (1985) conducted a study with 240 education 
students to determine the relative influence on course grade 
three treatment packages designed for private study . self-nioiii- 
toringof subgoals, self-monitoring of distal goals, and self-mon- 
itoring of time. In the subgoal group, students were given 
training in goals setting. They were then asked to set their own 
specific process and product goals and modes of e\aIuation for 
stuJy sessions in the target courses, and to record both their 
goals and their progress evaluations. In the distal goals group, 
students had the same training but set only one product goal for 
each session relevant to notes they took u?' -g a recommended 
format. Students in the time monitoring group set targets for 
the amount of time they wanted to study and kept records of 
time actually spent. The gi'oup that monitored time spent 
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studying did in fact spend more time studying. However, the 
group that set definite process-oriented subgoals for each study 
session outperformed both of the ot^er groups on final exami- 
nations. This group also indicated the highest degree of interest 
in the course. 

This seems of special interest for a number of reasons. 
First, the study design took into consideration several of the 
principles that Locke et al. (1980) associate with high effects for 
goal setting. Second, students in the subgoal and distai grjups 
set their own goals. Ihird, the subgoals used were process ori- 
ented, relating to specific study ta^ks connecvcd with the chap- 
ter being read. 

Research on the effects of goal setting on improving aca- 
demic performance is a relatively recent development, and 
rtsuiti are mixed. Further research is indicated, with careful 
consideration given to the types of goals that may prove most 
effective in boosting academic performance. 

To summarize, studies focusing on the relationships of 
career goaI.> and goal instability on performance indicated that 
students who set career goals early or who have an overall 
S(^nse of goal and value direction tend to perform better. It is 
difficult to determine the extent to which poor motivation 
causes a delay in setting career goals, or the extent to which not 
having career goals adversely affects motivation. 

Studies focusing on goal setting as a strategy for improv- 
ing academic performance vary in «.he type of goals set and 
other aspects of design, and show mixed results, further re- 
search is indicated. 

The study skills texts that address the issue of goal set- 
ting explicidy are the exception rather than the rule ThL 
should certainly change. Since goal setting can be done rela- 
tively easily and w ith little interruption in other activities, using 
this strategy along with self-monitoring or other seif-maiiage- 
ment strategies seems worth the effort, especially if evaluation 
procedures are included. 

Managing stress and anxiety. In a review of the empiri- 
cal literature related to anxiety and college-age students. Head 
and Lindsey (1982) examine numerous tudies and draw the fol- 
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lowing conclusions regarding the relationship between anxiety 
and academic performance: 

• a high anxiety level impedes performance, at least for 
poor and average students; 

• sometimes anxiety can be helpful Tor students oi high 
intelligence; 

• females tend to show a higher correlation between 
anxiety and performance than males and also tend to 
have higher levels of anxiety; 

• task difficulty has a definite effect on anxiety; and 

• certain instructional variables affect anjdety and thus 
performance. 

A number of studies have found a significant relation- 
bhip betv/een self-perceived problem-solving ability and anxi- 
ety (Gross & Mastenbrook, 1980; Hentschel & Ternes 1984; 
Nezu, 1985). These studies indicate thi.. ^udents who perceive 
themselves as poor pioblem solvers tend to be more anxious 
about life in genersi and about ac**demic pursuits in partici iar. 

Much literature has focused on reducing anxiety in order 
to improve perfontiance. In their review, Head and Lindsey 
(1982) distill the numerous recommendations made for reduc- 
ing anxiety down to three approaches that research findini,s 
suggest are reasonably successful, using behavior modification 
techniques, conducting group or individual counseling ses- 
sions, aiiu developing students' studying and test taking skills. 
Each of these approaches could be discussed in study skills texts 
as reasonable ways to manage stress and anxiety, other than 
Pauk (1984) and Wood (1986), the authors of the texts we re- 
viewed offered few suggestions in this '^rea. Test anxiety is ad- 
dressed more frMy by Wark and Flippo (Chapter 7, this 
volume). 

Implications 

Tiirce types of strategies regarding motivation seem 
worthy of special note. Research on problem solving and self- 
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monitoring seems to indicate that these strategies arc worth se- 
rious consideration for inclusion in study skills programs. Since 
they are process-oriented, they can be used to implement rather 
than replace other matters of concern, such as the teaching of 
reading comprehension. Goal setting also is of special interest. 
The theory that goal setting may be closely related to the moti- 
vational conscruct hab some suppon, and this strategy seems 
worthy of further research and instructional attention. 

Some concerns might be raised about strategies emerg- 
ing from the counseling literature being recommended for use 
by reading and study skills instructors without special training. 
However, the strategies that seem to show the most promise 
(sclf-moOii^ring and problem solving) are aot new and have not 
been confined to counseling environments. Richards (1981) 
points out that the idea of self-monitoring is at least 400 years 
old and has been used in many situations. Also, we recommend 
that study skill instructors avail themselves of opportunities for 
training in these procedures, either through coursework, inde- 
pendent siudy, or other means. A review of training manuals for 
self-control techniques is currently available (Glasgow & Rosen, 
1978). 

The need for further research is apparent, and study 
skills Kidtructors, especially thoi.e who work with required or 
credited programs that produce stable populations, are in a 
good position to conduct such research. Research using various 
components of both study strategies and self-control or related 
strategies seems desirable. 

Memory and Attention 

v^ur review of the theoretical and empirical literature on 
memory and attention has led us to identify three assumption^ 
that seem *o have influenced suggestions from study skills texts, 
questions for empirical research, ot both. First, variables such 
as assuming self-responsibility, developing a positive self-con* 
cept, establishing personal goals for learning, and managing 
stress and the learning environment not only enhance motiva* 
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tion but also influence the activation and maintenance of aiten- 
tion and memory. As Paulr (1984) states in his stuuy skills text, 
memoty is boosted by attention, and attention is dependent on 
interest. Whether tasks require rote memorization or complex 
learning, interest, memory, and attention affect each other as 
information is piocessed (Weinstein & Mayer, 1986). Since 
many of these factors have been discussed elsewhere in the 
chapter, we will emphasize here only those factors not previ- 
ously dealt with. 

The second assumption we identified is thai memory 
and attention are interactive, and activating them successfully 
depends on many of the same learninj^ strategies. Authors of 
study skills texts, however, typically have 'lichotomized learn- 
ing strategies, suggesting that each strategy is designed exclu- 
sively for the attainment of either rnemory or attention. They 
do not address the idea that these strategics may improve both 
memory and r.ttention simultaneo jsiy. For ex:;iiiple, one author 
may recomms^nd the use of reflective pause.', during reading as a 
way to focus attention while another may rt commend th^ ' ime 
technique as a -.vay to store information in long term memory. 

The confusion over w'.iethc a specific study strategy en- 
hances memory cr attention probably relates to a v:hanging the- 
oretical base. Theories of how memory operates and what 
constitutes attenti'^n are under constant re^ision. In examining 
models of information processing, .*^ucli as the one proposed by 
Cook and Mayer (1983), it is apparent that it \s not easy to iden- 
tify behaviors that are strictly memory or attention oriented. 
According to the Cook and Mayer model, for instance, attention 
and memory interact at every level of information processing. 
These levels include selection (the student actively attends to 
specific information, allowing this information to transfer into 
>vorl'.ing memory), construction (the student actively makes 
connections between ideas being processed in working mem- 
ory), integration (the student relates prior knowledge held in 
long term n^emory^ to new information in working memory), 
arid acquisitiut (the student actively transfers the information 
from working memory to long term memory ). In this section 



2S0' 



ERIC 



"ternal Factors That Influence Study 265 



we discuss specific study strategies as helpful for either memory 
or attention with the understanding that their functions are not 
mutually exclusive. 

The third assumption that relates to this review is that 
the strategies fc. aiding memory and attention (the process of 
learning) are often the same as those for improving comprehen- 
sion (the product of learning). Because some authors of study 
skills texts or empirical literature view comprehension as easier 
to measure than memory or attention, they often assume that if 
students are comprehending they are also attending and re- 
nr^mbering. This, however, is not an assumption that guided 
Our review or the presentation of information in this section of 
the chapter. We agree with Baker and Brown (1984) and 
K.atsch (1986) that reading to comprehend and reading to re- 
member involve different tasks. While comprehension is desir- 
able for studying, to remember information a student must 
employ purposeful use of memory -facilitating activities (Baker 
& Brown; Weinstein, 1987). ¥o: this review, only theoretical lit- 
erature and empirical research related explicitly to how strate- 
gies enhance memory and attention are discussed. 

Managing Memory: Suggestions from Study Skills Texts 

Most authors of the study skill texts we reviewed (88 per- 
cent) make suggestions about ways to improve students' mem- 
oi}. These authors usuall> preface their suggesiions to enhance 
memory- with a description of long and aort term memory. 
They note that . * ^jnitive psycho' ogists describe memory as the 
process of retaining infonriation in the brain and then retrieving 
it when it is nf^eded. Consistent with our definition, these 
authors describe memory as an active and selective process 
requiring the use of c)trategies for the reconstruction, storage, 
and retrieval ol information. The suggestions these texts offer 
for enhancing memory seem to relate directly to four interre- 
lated areas, mnemonics, classification, summarization, and 
elaboration. 

In their study skills text. Postman, Keckler, and 
Schneckncr (1985) define mnemonics as "memory words," or 
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words, phrases, jingles, or acronyms used to aid memory for 
specific information. Mnemonics (also called ''memory tricks" 
by McWhoner, 1987, and Shennan, 1984) are recommended to 
help students rehearse information that has no inherent, mean- 
ingful organization (Nist & Diehl, 1985; Sotiriou, 1984) or lists 
of factual information (McWhorter, 1987; Wood, 1986). 

Even though mnemonics are recommended by most au- 
thors of study skill texts, all authors who discussed memoiy 
provided additional suggestions. To enhance memory of text 
ideas, students are encouraged to use text information meaning 
fully by summarizing, classifying, and elaborating on the text. 
The authors present vanuus activities to develop each of these 
strategies. For example, students are advised to rewrite ideas 
from their texts in their own words (McWhorter, 1986a, 1986b, 
Postman, Keckler, & Schneckner, 1985; Sherman, 1984;, attach 
details to main ideas and choose specific details to be remem- 
bered Ooffe, 1988; McWhorter 1986a, 1986b, 1987; Pauk, 
1984; Postman, KecUer, & Schneckner, 1985; Sotiriou, 1984; 
Wood, 1986); rely on prior knowledge to aid understanding of 
new information Qoffe, 1988; McWhorter, 1984, 1987; Pauk, 
1984; Wood, IS'36); devise or make use of associations or anal- 
ogies among units of information (Pauk, 1984, Sherman, 1984, 
Sotiriou, 1984); and discover text organ zation (McWhorter, 
1987; Sherman, 1984; Wood, 1984). 
t 

Mana^^ng Memory: Related Literature 

Mnemonics. Numerous researchers (Bellezza, 1981; 
Levin, 1981) attribute the ability to remember information, at 
least in pan, to the use of deliberate mnemonic strategies. In a 
survey by Carlson et al. (1976), college students usmg mnemon- 
ics to learn a list uf words had a higher opa than students who 
did not generate mnemonics to aid recall. Experiments in 
which students were induced to use organization ! mnemonics 
(those that relate apparently unrelated information) and encod- 
ing mnemonics ^those that transform information into another 
framework) revealed superior recall of information. Mnemonic 
devices producing su^h favorable results included the organiza 
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tional method of loci, in which students assign units of infor- 
mation to vis'-^l images of specified locations (Groninger, 1971; 
Ross & Lawrence, 1968); peg words, in which units of informa- 
tion are assigned to images of concrete objects and remembered 
in serial order (Bugelski, 1968; Morris & Reid, 1970; Wood, 
1967); and links, in which units of information are linked to 
one another through visual images (Delin, 1969). Using an orga- 
nizational mnemonic to create meaningful associations through 
construction of simple stories (Bower & Clark, 1969) or to de- 
velop hierarchical relationships to remember lists of unassoci- 
ated words (Wittrock & Carter, 1975) also was found to 
improve college students' retention of information. 

Encoding mnemonics, such as keyword devices and vis- 
ual imagery, have also been used to facilitate memory. The liter- 
ature provides at least some support for the use of keywords to 
induce visual images of representative and meaningful words. 
This strategy was found to help college students memorize defi- 
nitions of unfamiliar words (Sweeney & Bellezza, 1982) and 
foreign language vocabulary (Atkinson, 1975; Atkinson & 
Raugh, 19"'5; Raugh & Atkinson, 1975); however, i:o usefulnrss 
for college foreign language learners du&cribed as **good stu- 
dents'* was not substantiated in a study conducted by Hall, 
Wilson, and Patterson (1981). The keyword method as defined 
by Levin (1981) and others requires the learner to establish a 
keyword that has an acoustic link to the word or words being 
memorized and to form an imagery- link between the keyword 
and the meaning of the information to be learned. Visual im- 
ages that create a context or situation for new information ma) 
produce recall of related infowTiation. Roediger (1980), for in- 
stance, found that images created by a group of college students 
to encourage serialized recall worked better than the formation 
of separate images for each item of information lo be learned. 
In an earlier study. Bower (1972) also found that simultaneous 
formation of two separate images produces w eaker associations 
than composite, interacting images. 

While authors of study skills texts do not distinguish dif- 
ferent levels of mnemonic learning, their suggestions for study 



Rtsko, Fairbanks, and Alvarez 




strategies can be categorized into at least two levels, simple rep- 
etition and meaningful organization of information to be re- 
membered. Support for different levels of learning through 
mnemonics is found in the literature. For example, Weinstein 
and Mayer (1986) categorize mnenomics as either lehearsal (i.e, 
repetition, such as the use of peg words) or elaborativc (i.e., 
meaningful organization, such as the keyword method). 

Although mnemonics are commonly associated with 
rote learning, Bellezza (1981) distinguishes mnemonic learning 
fium learning by rote or learning by assimilation. He acknowl- 
edges that a simple verbal rehearsal (rote learning) may influ- 
ence memorization of factual information, but he argues that it 
is the least efficient way of enhancing memoiy According to 
Bellezza's framework, mnemonics provide organization (de- 
scribed as "cognitive cueing structures") of the information so 
it can be remembered. The cognitive cueing strCictures can take 
the form of rhymes, visual images, or stories and serve as s 
nals to aid retrieval of information from memor}. According to 
Bellezza, mnemonics are also different from assimilative learn- 
ing, which he describes as thr ability to remember information 
through associations with prior knowledge. According to this 
model, then, a mnemonic can be used to provide a meaningful 
classification system, such as the loci or key word methods, and 
is used when prior knowledge is not activated to provide a 
strategy for remembering. The authors of study skills texts seem 
to follow this model. 

The use of deliberate mnemonic strategies can produce 
superior recall of certain ty pes of information, particularl) lists 
of words or meaningful words for which images can be in- 
duced. As one strategy for learning, mnemonics may have an 
important effect on students' memory and attention power. F3e- 
cause of its limitations for more complex learning, however, 
mnemonics should be used in combination with other karnmg 
strategies (for instance, classification of thematic information). 

Classification, Ck ^ifying information according to 
meaningful clusters is a common theme of stud) skills texts and 
is seen as important in improving memory. In general, students 
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are advised to follow one or more of three strategies to organize 
information according to (1) major and supporting ideas, (2) 
the author s text struv^ture, and (3) clusters or networks to illus- 
trate relationships among superordinate and subordinate infor- 
mation. 

The first of these strategies, preservation of meaning in 
memory, appears to require the ability to understand the central 
concepts and to selectively omit less relevant information 
(Gomulicki, 1956). The suggestion that students organize infor- 
mation around main ideas and supporting details is supported 
by the empirical literature. In their study with college students, 
Reder and Anderson (1980) conclude that subordinate informa- 
tion can be retrieved from memory only if the higher level in- 
formation is retrieved first. Additionally, understanding the 
theme or najor concept of a passage and its relati'^n to support- 
ing details while selectively omitting less rele\ani details has 
been found to have a positive influence on memory of text 
ideas (Alvarez & Risko, 1982, 1989, Bransford & Johnson, 
1972; Dooiing & Christiansen, 1977; Gomulicki, 1956; Pompi 
& Lachman, 1967; Sulin & Dooiing, 1974). 

The usefulness of the second strategy, reliance on text 
organization to aid recall of information, has been established 
for some age groups (Frasc, 1969, 1975; Montague & Carter, 
1973; Myers, Pezdek, & Coulson, 1973), but its effect on col- 
lege students' recall is not well-grounded in the empirical litera- 
ture. Research presents us with evidence that children as young 
2S 5 years old can rely top-level information to aid memory 
(Christie & Schun^acher. 1976). Identifying and using the au- 
thor s stru ture has b .^n found to aid the retention of elemen- 
tary and middle school students ^^Bartlett. 1978; Taylor & 
Beach, 1984). Ideas that are funct anally important according 
to an author's text organization Atr often recalled more easily 
than lower-order information (Meyer, 1975; Ru0ielhart & 
Ortoiiy, 1977; Thorndyke, 1977). Further, explicit instruction 
on how to use top-level information was found to be helpful for 
retrieval of information by middle school students (Bartlett, 
1978; Taylor, 1982), 
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Alerting students to text patterns to facilitate memory 
was not supported by Horowitz (1982). There is some c\ Idence 
that college students art insensitive to text structure (Cooper et 
al., 1979), but further research with college students needs to 
be conducted to establish more precisely whether eliciting or 
inducing sensitivity to text structure across texts of varj'ing or- 
ganizational patterns will affect memory of text ideas. 

The third strategy, making maps or networks to illustrate 
relationships among text ideas, is recommended (V^einstein, 
1987), and has been found to aid college students' memory 
(Dansereau et al., 1979; Diekhoff, Brown, & Dansereau, 1982), 
Concept maps, as developed by Novak and Gowin (1984), are 
diagrams that visually represent a set of "concept meanings em- 
bedded in a framework of propositions" (p. 15). Research by 
Novak and Gowin and their colleagues revealed that tcachiiig 
.oliege students how to construct concept maps has a powerful 
effect on retention of information (Cardemone, 19T'5; 
Minemier, 1983; Novak & Gowin, i984). Concept map. pro- 
vide students with a strategy to identif) the hienirchical ar- 
rangement of concepts w ithin texts and a way to cross-link 
relationships among text ideas. 

Strategies such as identif>ing a text s central information, 
relying on text structure, and generating maps or conceptual 
fran»cworks seem to have potential for helping college students 
organize and classify text ideas. Although more researcli is 
needed to determine the effects of these procedures on stu- 
dents' learning and achievement, explicidy alerting students to 
important text ideas seems important for enhancing memorj. 
Once students are able to classif) and interrelate information to 
be remembered, they should br better able to summarize and 
synthesiz.^', this information. 

Summarization, Summarizing is another strateg) com- 
monly recommended in study skills texts. It is seen as an acti\- 
ity that may encourage readers to allocate their attention more 
effectivel) so that memor^ of important information increases 
(Barclay, 1973; Honeck, 1973; Ross & DiVesta, 1976; Tierney & 
Cunningham, 1984, Weinstein, 1987). Corresponding to the ra- 
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tionak for classifying text information, the authors of study 
skills texts describe summarizadon as a way to help students re- 
duce text information into meaningful units. 

The use of a strategy such as summarization to reduce 
information to **gist" as a method to ennance memor)' is sup- 
ported across a number of studies. For example, Welborn and 
Env^lish (1937), after a review of 83 expmments, concluded 
that memory for gist was more durable \ ^ memory for exact 
wording of information. Even with repeated practice, memor}' 
for gist rather than for verbatim information seemed to aid re- 
tention better (Howe, 1970); in addition, it was less resistant to 
interference from form change, such as a shift from passive to 
active voice (Sachs, 1967). Anderson (1980) and Howe and 
Singer (1975), however, found that rereading was a more effec- 
tive strategy than summarizing for aiding college students' 
memor)'. 

In their reilew of empirical research on the effects of 
summarization on learning, Anderson and A'^bruster (1984) 
conclude th, t summ.arization is more likel) to influence reten- 
tion of infomiation if students are taught how to summarize 
and if the information that is summarized relates to the crite- 
rion task. Brown, Campione, and Day (1981) report an example 
of this finding. Working with low-ability community college 
students. Da) studied the effectiveness of summarization train* 
ing with and without explicit cues intended for facilitating self- 
monitoring. She concluded that students with more learning 
problem- required more explicit training m summarization. Pro- 
\idmgsuch explicit training until the students could follow the 
uiles of summarization seemed to improve their ability to recall 
main ideas and delete less important information. Brown & 
Campione (1978) found that junior college stucH^nts were un- 
able to adequatel) abbre\iate text. Providing college students, 
who may not possess adequate sumn^^rization skills, with in- 
struction in how to summarize— rather than just telling hem to 
do so without instruction — may be what is needed in study 
skills texts for college students. Providing students with strate- 
gies fur independent use of information in a meaningful waj 
may further help students remember important ideas. 
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Elaboration. Advising students to use information 
meaningfully to increase memory and learning encompasses 
the concept of elaboration, or integrating prior knowledgv into 
new information (Mayer, 1982, 1984; Weinstcin, 1987; Wein- 
stein & Mayer, 1986), While strategies such as mnemonics may 
enhance the **work *pace for problem-solving" function of 
working memory (Schiffrin & Schneider, 1977), long term 
memory is better enhanced by more meaning-oriented strate- 
gies (Bov>; 1981; Craik & Watkins, 1973). We kno' from re- 
search, even with ver> young children, that memor) increa&e^ 
substantially when the material is meaningful, but "meaning- 
ful" is a relative term. Learning and memory are context sensi- 
tive (Jenkins, 979), varying with the characteristics of the 
students, the text, the criterion task, and the learning content 
(Ca^'crly & Orlando, this volume). 

The advice of stu 'y skills texts to :issociate text informa- 
tion with prior knowledge has support in both the theoreiic'l 
and empirical literature. Elaborating, oi ^establishing connec- 
tions between prior knowledge and be-learned information, 
plays a major role in knowledge acquisition (Schallert, 1982, 
Weins!ein & Mrvyer. 1986). According to Wittrock's (1981, 
1986) model of generative learning, students* abilit) to generate 
relationships between text information and prior knowledge is 
dircctl} related to learning and memor). Se\eral researchers 
have concluded that prior knowledge has a powerful effe, jA 
the learning of college students. Wittrock and Cart'jr (1975) 
found that co." . students w ho were asked to generate mean- 
ingful ;issociatiu among hierarchicall) arranged words sigr.ifi 
cantly increased their retention of those words. In studies 
conducted with cjllege students and adults, Andc^^on et aL 
(19"'"') and Snyder and Uranow itz (1978) concluded that the 
reader's perspect'^ . influences the amount and nature of recall, 
and that prior knowledge encourages inferences about text 
ideas. 

In another series of experiments, Dansereau and his col- 
leagues (Dansereau ct al., 1979; Diekhoff, Brown, & Dansereau, 
1982) found that encouraging students to use elaborativc strate- 
gies aided memory of text ideas. lU the treatment group, stu- 
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dents working in pairs summarized what they read and then 
provided corrective feedback on each other's summaries. The 
researchers named this strategy MURDER, which stands for 
Mood (positive mindset for reading), Understand, Recall, De- 
tect (check for errors). Elaborate, and Review. The murder 
strategy involves learners in identifying, defining, and elaborat- 
ing on key concepts and encourages them to self-monitor this 
knowledge. In these studies, the treatment group received sig- 
nificantly higher scores on recall tests than did students who 
were not trained. 

Managing Attention: Suggestions 
from Study Skills Texts 

Terms such as attention, concentration, intentional 
learning, and active panicipation are often used interchange- 
ably by authors of study skills texts. For this chapter, we use the 
term attention to represent this area of study. Stud) skills texts 
generally describe attention as a limited capacity requiring an 
ability to focus on one thing while eliminating thoughts of 
other things (Joffe, 1988). In order to elicit and maintain atten- 
tion, these authors recommend direct, purposeful, and selec- 
tive aaion on the learner's part. 

Among the strategies these authors suggest to aid atten- 
tion are: 

• establishing a study environment conducive to learn- 
ing, widi good lighting, appropriate equipment, and 
minimal external distractic i (Pauk, 1984; Smith, 
1981); 

• setting goals, such as time goals, or establishing moni- 
toring sheets on which goals or tasks are listed Qoffe, 
1983; McWhorter, 1986a, 1986b, 1987; Shepherd, 
1987; Smith, 1981). 

• using the *'humble pencil technique"— studying with 
a pencil in hand and summarizing, underlining, or 
writing down key words QoUc:, 1988; McWhorter, 
1986; Pauk, 1984); 
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• having a positive attitude (McWhorter, 1987; Pauk, 
1984); 

• using study questions (Sherman, 1984); 

• being an active reader by using reflective pauses, mak- 
ing notes, and self-checking (Sherman, 1984); 

• rewarding personal study effort Qo((e, 1988; 
McWhorter, 1986a, 1986b; Shepherd, 1987); and 

• relating new information to current knowledge 
(Sherman, 1984). 

Some of these strategies have been discussed previously. 
Only those strategies that have not been discussed elsewhere in 
this or the previous chapter will be addressed here. These re- 
maining strategies seem to relate to the effect of goal setting on 
attention, the "pencil in hand" strategies, or self-monitoring. 
We will also present suggestions from our review of related liter- 
ature (e.g., use of text overviews or advance organizers), even 
though these suggestions do not correspond to recommenda- 
tions made by authors of stuoy skills texts. 

Managing Attention: Related Literature 

Several investigators (Anderson, Spiro, & Montague, 
1977; Weinstein & Mayer, 1986; Wittrock, 1986) support the 
use of certain learning strategics to facilitate selective attention, 
which is defined as the ability to make active choices about in- 
formation to be learned. Rather than relying on concepts such 
as practice, reinforcement, or review to explain how concen- 
trated efforts encourage learning, some researchers have pro- 
posed and investigated models of attention (Wittrock, 1986). 
Research on how strategies can help students focus •"n certain 
kinds of information has provided us with insights about the 
effects of selective attention on memory and achievement. 

Goal-setting activities. The use of cues, encouraged by 
college instmctors and authors of content texts, has helped sr^- 
dents direct their attention to important concepts. Cueing strat- 
egies such as inserted questions (Andre, '979; Reynolds & 
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Anderson, 1980; Rickards, 1976), prereading objectives (Borer, 
1981; Duchastel, 1979; Duell, 1974; Levin & Pressley, 1981; 
Melton, 1978), pretests (Hartley & Davies, 1981), guiding ques- 
tions (Page, 1988), and postrcading response criteria 
(Alexander, 1986) have been shown to help upper elementary, 
secondary, and college students to focus directly on criterion- 
relevant information (Baker, 1974; Bovy, 1981; Kaplan & 
Simmons, 1974). Such findings arc consistent with attentional 
models of learning (Wittrock & Lumsdaine, 1977) in which the- 
orists have speculated that when attention is focused on task- 
relevant information students will attend morc closely to this 
information. 

Researchers have attempted to monitor such attention 
focusing to determine morc prccisely how college students' at- 
tention is allocated. For example, McConkie, Rayner, and 
Wilson (1973) found that when college students constrained by 
time werc encouraged to pace their rcading, they dirccted their 
attention to the more task-relevant information and did not 
learn incidental information as well. Britton, Muth, and Glynn 
(1986) also found that students making an extra cognitive effort 
allocated attention to important information when processing 
time was limited. Manipulating the rate of text presentation by 
computer control, AUessi, Anderson, and Goetz (1979) found 
that focusing attention on important information through text 
look-backs related closely to performance on criterion texts. 

Across a series of studies in which prereading goals 
(Anderson & BiJdle, 1975; Rothkopf & Billington 1979) and 
text insetted questions (Britton et al., 1978) were presented to 
college students, researchers concluded that students werc bet- 
ter able to answer questions on target in^'urmation and to in- 
crease their inspection time and cognitive effort when they 
focused on task-relevant information. In a study b]^ Alexander 
(1986), prereading directions encouraged college student^, to 
stay with a task to redo all or part of postreading questions. As 
Anderson and Armbruster (1984, p. 663) note, this increased 
focusing may produce a '*burst of processing energy or a quan- 
tum Lap in cognitive effort" that influences learning; the gen- 



E R^C n ' M Fairbanks, and Aluarez 



eration of deliberate behavior is probably stimulated by 
orienting tasks, such as prereading goals. Consistent with the 
theory of encoding specificity (which states that **etrieval of in- 
formation is influenced by ci'es received during acquisition), if 
learners have complex, meaning-oriented goals, they will focus 
their attention on a search for meaning relevant to those 
goals— in other words, they will engage in transfer-appropriate 
processing (Morris, Bransford, & Franks, 1977). 

''Pencil in band" strategies. A second set of factors that 
have been studied are those incorporated in what Weinstein and 
Mayer (1986) describe as complex rehearsal tasks. These in- 
clude such strategies as copying material, taking selective verba- 
tim notes, outlining, and underlining. In general, these 
strategies are supported by researchers because they allow time 
for the learner to select and practice specific information- 
gathering techniques. As indicated by Brennan et ai. (1986), 
however; college students seem to prefer relying on underlining 
as a study strategy and excluding other options. 

Studies conducted with college students seem to sup- 
port the notion that such strategies may be beneficial because 
they aid the learner in directing attention to specific informa- 
tion. For example, Weinstein and Mayer (1986) argue that -f a 
rehearsal strategy such as underlining is effecti- e— as indicated 
by Blanchard & Mikkelson (1987), Fowler and Barker (1974), 
Rickards and August (1975), and Schnell and Rocchio (1975)— 
it seems to be because the learner is allocating more attention to 
acquire information. However, Weinstein and Mayer argue that 
there is little evidence that these rehearsal strategies help learn- 
ers establish internal connections between text ideas or relate 
text information to prior knowledge (Caverly & Orlando, this 
volume). 

The effectiveness of notetaking, another rehearsal strat- 
egy, on college students' learning has also received both sup- 
port (Bretzing & Kulhav>, 1979) and notes of caution 
(Anderson, 1980; PoppJeton & Austwick, 1964). Anderson and 
Armbruster (1984) conclude that notetaking can be effective in 
aiding study efforts if it encourages more attention to text ideas 
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that are needed for criterion tasks. Mayer (1988) indicates thai 
learning strategies aimed at focusi^ig attention may be most use- 
fill when the goal of the learning task is to retain specific infor- 
mation rather than to determine which information is 
important to be learned. 

Self-monitoring strategies. The authors of some study 
skills texts also suggest that students engage in activities that in- 
volve self-monitoring, (e.g., reflective pauses, self-questioning), 
but these authors do not provide explicit directions for doing 
so. Encouraging students to make active and conscious deci- 
sions about learning is recommended to erJiance memor>^ at- 
tention, and motivation. There is some evidence that college 
students usually do not monitor their comprehension and that 
even when they do, they are inconsistent about it (Baker & 
Anderson, 1982; Brennan et al., 1986). Brennan and her col- 
leagues found college students' self-reporting of strategic use to 
be different from actual use during observed study sessions. 

College students who do monitor their study behavior- 
defined as self-observation— have consistendy achieved higher 
grades than students who are not self-monitors (Groveman, 
Richards, & Caple, 1977; Johnson & White, 1971; Richards et 
al., 1976; Richards & Pern, 1978; Richards, P-^rri, & Gortney, 
1976). Diekhoff, Brown, & Dansereau (1982) have established 
positive effects on information retention through their coopera- 
tive learning model (murder), which requires each student to 
monitor his or her processing of text information by listening 
and providing feedback to peers. 

Self-questioning strategies have been found to be effec- 
tive for college students. Uuell (1978) round that students who 
developed multiple choice items from instructional objectives 
outperformed their peers v^ho studied with J list of objectives. 
A similar fine ing was reported by Frase and bchwartz (1975) in 
a study in which college students who read a text and wrote 
questions performed better than their peers who simply read 
the text. 

Advance organizers. Most authors of study skills texts 
do not explicidy direct students to use text-embedded over- 
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views or advance organizers (Ausubel, I960, 1968) to aid selec- 
tive attention, even though they consider these strategies 
impoilant in other aspects of studying. Although college stu- 
dents may not spontaneously use prereading strategies 
(Brenann et al., 1986), the use of previews or advance organiz- 
ers has been found to help them focus their attention on impor- 
tant ideas, allowing them to elaborate and improve their 
retention ^ayer, 1979; Reigeluth, 1979). In a study conducted 
with college students, Goetz et al. (1983) found that the read- 
er's perspective affected the allocation of atte^ition, with more 
attention given to sentences relevant to the learner's prior 
knowledge or orienting framework. As suggested by Cirilo and 
Foss (1980) and Reynolds and Shirey (1988), attention is allo- 
cated to information deemed important according to the learn- 
ing context or goals of the reader. Students can use strategies 
such as overviews, analogies, and narrative advance organizers 
to help them activate their prior knowledge and to focus their 
attention on relevant and important information. 

implications 

There is a considerable amount of correspondence be- 
tween what authors of study skills books suggest and what has 
been reported in the theoretical and empirical literature in re- 
gard to memory and attention. Both memory and attention are 
thought of as active and selective processes that can be en- 
hanced by specific study strategies. The effectiveness of such 
strategies as mnemonics, classifjcati )n, summarization, mean- 
ingful use of information, goal setting, and text overview with 
selected groups of students has been amply supported. Still 
needed are more explicit directions for the use and implementa- 
tion of these strategies. 

Although, for the most part, trends in research and the 
suggestions made by the authors of college study skills texts are 
congruent, it is difficult to determine whether the strategies rec- 
ommended in the study skills texts are the most appropriate 
ones for students in college study skills programs. While re- 
searchers have reported positive effects of specific study strate- 
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gies on memory and attention, this research has been 
conducted with college students enrolled in undergraduate psy- 
chology courses. Typically, researchers have not identified 
these students as having academic problems. Authors of study 
skills texts have relied on this literature, however, and have ap- 
plied the findings of studies with mixed populations (students 
with both high and low levels of achievement) to a limited por- 
tion of that population (students with academic problems). Re- 
search is needed on the effects of target strategies on low 
achievers* learning and performance. Also, because study skills 
texts do not place much emphasis on self-moritoring of atten- 
tion and memory strategies, it is not known whether students 
who know about these but do not use them will benefit from 
this approach. Finally, there is a need for research on the differ- 
ential effects of strategies to determine what may work better 
for certain students and certain materials in specific learning 
contexts. 

Conclusions 

From our content analyiis of college reading and study 
skills texts and our study of corresponding literature, three ma- 
jor conclusions can be made about motivation, memory, and 
attention. First, there is both pragmatic and theoretical/empiri- 
cal support for teaching college students to control their own 
study efforts. Among the strategies strongly supported in the lit- 
erature are those that help students establish self-reinforcing 
schedules and generate questions about the material they are 
studying. Students need to be encouraged to be self-disciplined 
and to make decisions about what is important for them to 
leam and to remember. The strategies discussed here are sug- 
gested to help students become aware of the processes of learn- 
ing applicable to different learning contexts. The major 
discrepancy between the study skills texts and the literature is 
the amount of explicit information presented. Authors of study 
skills texts advise students to manage and govern their own 
learning, but for the most part they are not precise about how 
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students can acquire independent learning strategies and apply 
them to novel contexts (i.e., their content classes). 

Our second conclusion is that students need to be en- 
couraged to develop organizational strategies such as relying on 
text structure, relating subordinate details to central concepts, 
relating new information to prior knowledge structures, being 
selective about the information to be learned, and generating 
concept maps or networks. Such strategies are designed to help 
students reduce large masses of information into meaningful 
chunks or units. Authors of study skills texts and empiricists 
suggest thai organizational aids help students to better manage 
and focus their study time. 

Third, our review suggests that some recommendations 
within study skills texts may require a multidisciplinary ap- 
proach. For exainple, while some study skills authors suggest 
ways for students to reduce their own strcss level and to cope 
with anxiety, others suggest that counselors be brought in to 
train students in such strategies. Further study is needed to de- 
termine the extent and the range of optimal multidisciplinary 
resources. 

These suggestions arc offered for authors of reading and 
study skills texts, instructors of classes for college students with 
academic problems, and researchers. As an extension of what is 
currently found in reading and study skills texts, authors of 
such texts could include explicit information about the pro- 
cesses through which students can progress in self-monitoring 
and problem-solving strategies (Brown, Campione, & Day, 
1981). In general, the authors of study skills texts explain nei- 
ther the importance of nor the process for students taking re- 
sponsibility for their own learning through the use of 
self-monitoring strategies such as self-observation, self-ques- 
tioning, and goal setting. The relationship of such strategies to 
motivational attainment and the activation of attention and 
memory strategies needs to be explamed to college students. 
The benefits and liipitations of mnemonics as a rehearsal strat- 
egy should be explained in a context that illustrates how other 
strategies, such as goal setting, classification of thematic infor- 
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mation, and reliance on text structure cues, can be developed to 
increase attention on and memory of complex information pre- 
sented in texts. Procedures to identify and solve problems 
should be included and applied to content arereS. 

Instructors of college reading and study skills courses 
should provide well-balanced programs including strategies to 
promote motivation, self-mopitoring, and ^^roblem solving. 
They should p,ive students opportunities to learn how to apply 
self-monitoring and problem-solving strategies to their learning 
contexts. Instead of having students complete exercises within 
continued study skills learning situations or contrived texts, in- 
structors should encourage them to apply study strategies to the 
learning tasks and texts in their classes. Instructors can serve as 
coachies and consultants to help students apply study strategies 
to their content classes (Schallert, Alexander, 3c Goetz, 1988). 
Strategies that respond simultaneously to multiple factors that 
affect learning should be emphasized. For example. Memory 
and Yoder n988) provide a study strategy to improve 'concen- 
tration th? t also helps students monitor their concentration ef- 
forts, set goals for study, eliminate distractions, maintain an 
interest in the content being studied, and provide rewards for 
personal study. Gill and Bear (1988) suggest that variations of a 
directed reading-thinking activity can aid students' memory of 
text ideas as well as self-monitoring. Methods to record and 
evaluate the use of strategies should be practiced during in-class 
discussion, individual conferences, or both. 

Oui review suggests that additional research is needed in 
our target areas. Specifically, we see a need for systematic re- 
search investigating how strategies currently popular in study 
skills texts affect the learning of college students enrolled in 
reading and study skills classes. Ciofffs (1986) research pro- 
vides a description of strategy clusters that high-achieving col- 
lege students use when studying (e.g., use of imagery and 
paraphrasing to focus on target concepts) and suggests a line of 
study that may influence effective remedial interventions. Too 
much research has focused on the products of studying rather 
than on strategic behaviors that influence study efforts 
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(Alexander, 1986; Rothkopf & Bisbicos, 1967). Theoretical 
framewor!.:s (Kirschenbaum & Perri, 1982) to examine the inter- 
action of various task-related straiegie.s (Alexander, 1986) and to 
determine th^ most useful research approaches to academic in- 
tervention for college students with academic difficulties need 
to be explored. Examining the effects of training on students' 
perception of competence and strategic behavior (Palmer & 
Goetz, 1988) could identify effective intervention strategies to 
modify study efforts. 
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Preparing for and 
Taking Tests 

David M. Work 
Rona F. Flippo 



n this chapter we review the techniqiies of preparing 
for and taking tests at the college level. We open with 
an introduction to useful skills and follow with an oaensive re- 
view of the literature on test coaching and test wi/eness for ob- 
jective examinations, strategies for taking those tests, and the 
tieatment of test anxiety. A section on implications for practice 
contains suggestions on how instructors can teach strategies for 
preparing for and taking tests and how students can apply them. 
Finally', we include a brief summary of implications for future 
research. 



The Learnable Skill of Preparing for a Test 

Tests are - fact of life for anyone moving through the ed- 
ucational system or up a career ladder. Students must perform 
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acceptably on tests to pass their courses and receive credit. Stu- 
dents expecting to receive financial aid must have appropriate 
grades and test scores to qualify. Admission to graduate school 
depends largely on test grades. Some occupations require tests 
to advance, or simply to remain employed in a current posi- 
tion. Many professionals must pass tests to qualify or be certi- 
fied in their fields. Considering all the ways test scores can 
affect lives, knowing the techniques of preparing for and taking 
a test can be very useful. That ir/onmation, along with methods 
of teaching it, should be part of every reading and study skills 
instructor's professional toolkit. 

The research literature supports the idea that special in- 
struction in preparing for and taking a test can lead to higher 
scores. Studies show positive effects among various popula- 
tions for a variety of approaches. Marshall (1981), for instance, 
cites reports from some 20 institutions higher education. 
Across that range, nearly 4 1 percent of the students leave before 
the start of their second year, and 50 percent leave before grad- 
uation. Some of these dropouts and transfers are, of course, due 
to financial, social, personal, and developmental concerns. But 
the author cites studies showing that retention is improved 
when supportive services like instruction in study and test mak- 
ing skills are made available to students. Otiier researchers have 
found similar results. Arroyo (1981) showed that Chicano col- 
lege students' tes. and class performance, as well as their study 
skills, improved when they were taught to use better study and 
test taking procedures through a self-monitoring and modeling 
approach. Evans (1977) produced the same type of gain work- 
ing with black students using a combination of anxiety reduc- 
tion and basic problem-solving methods. 

Further, the literature shows dearly that even major tests 
are amenable to test practice and training. To name only a few, 
scores on the Scholastic Aptitude Test (SAT) (Slack & Porter, 
1980), the Graduate Record Examination (GRE) (Evans, 197"^, 
Swinton & Powers, 1983), the National Board of Medical Exam- 
iners (NBME) (Scott ct al., 1980), and the Georgia Regents' Com- 
petency Exam (Naugle & iMcGuire, 1978) have increased after 
use of a variety of training approaches. 
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The literature covers many distinct topics under the 
bioad categories of test preparation and test taking, including 
philosophical orientations, specific drills for coaching students 
to take cerr:iin tests, special skills such as reducing test anxiety, 
and test wiseness strategies. In this chapter we review the re- 
search and application literature relevant to these areas for the 
postsecondary and college student. Some of the studies re- 
viewed were conducted with younger student populations. We 
include those when findings or implications are useful to post- 
secondary and college students or to reading and study skills 
specialists working with that population. 

Instruction in test preparation and test taking can make a 
difference in some students' scores. The literature shows that 
students from different populations, preparing for tests that dif- 
ferentiate at both high and low levels of competence, may im- 
prove their scores using a number of training programs. This 
chapter explains and extends these results. 

Coaching 

Coaching is a controversial area in tes*: preparation, 
partly because the term is poorly defined. Both Anastasi (1981) 
and Messick (1981) acknowledge that ihe word has no agreed 
upon meaning in the measuremet^t field. A c :)aching program 
can have any combination of strategies or exercises in test famil- 
iarization, drill and practice, motivational encouragement, tak- 
ing tests with specific item formats, subject matter review, or 
cognitive skill development. Other components may be special 
modules such as test wiseness or test anxiety reduction. The du- 
ration of a coaching progra^m may be from 1 hour to 9 hours or 
more (Samson, 1985). 

Because the operational definition of coaching is so var- 
ied, it evokes a range of reactions and raises a variety of issues. 
For the purposes of this chapter we use a widely permissive def- 
inition and include studies that involve any test preparation or 
test taking technique in addition to formal instruction in the 
knowledge content of a test. 
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One of the issues Xi^^^d by coaching is actually a prob- 
lem of social policy. The argument is that students from eco- 
nomically disadvantaged schools or families will not be able to 
afford expensive coaching courses (Nairn, 1980). Conse- 
quently, decisions based on the results of the tests when some 
students have had coaching and some have not are inherently 
unfair. The same argument is offered when the examinees arc 
not uniformly told of the kinds of special preparation they 
should undertake (Cait, 1980; Green, 1981). Referring specifi- 
cally to the SAT, Anastasi (1981) says thai mdividuals who have 
deficient educational backgrounds are more likely to reap bene- 
fits from special coaching than those who have had **euperior 
educational opportunities" and already are prepared to do well 
on tests. 

Another and more technical debate focuses on the prob- 
lem of transfer. What is transferred from the coaching to the test 
taking, and ultin^ lely to the performance being assessed or pre- 
dicted? Anastasi believes that the closer the resembi^ -^e be- 
tween the test content and the coaching material is, th greater 
the improvement in test scores will be. However, the more re 
stricted the instruction is to specific test content, the less valid 
the score will be in extending to criterion perfonnance. In es- 
sence, the argument is that coaching reduces the validity of the 
test. 

A third issue is that of maximal student development. 
Green suggested that certain types of coaching should, in fact, 
become long term teaching strategies. The notion is th^.t com- 
prehension and reasoning skills should be taught at the elemen- 
tary and secondary levels and that school programs should 
integrate the development of thought with the development of 
knowledge. Schools also nould prepare students in ways that 
reduce anxiety over being evaluated, aiid not simply familiarize 
them with test formats and test taking slclils. 

Note that the social policy, transfer of training, and stu- 
dent development arguments make a common assumpr>on. 
coaching does have a real, observable effect. If not, there would 
be no reason to fear that many minority students are disadvan- 
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tagcd by their inability to afford coaching classes. Similarly, if 
coaching were not associated with gains in certain important 
test scores, there would be no need to debate whether the gain 
signified an increase in some basic underlying aptitude cr 
whether the schools should take the responsibility of coaching 
scholarship. These arguments do not settle the debate. In fact, 
they raise a basic question: How effective is coaching? 

The effects of coaching. Consider first the sat. Anasiasi 
(1981 J reports that the College Board, concerned about 
ill-advised commercial coaching, h:is conducted studies cover- 
ing a wide variety of methods. The samples included white and 
minority students from both urban and rural areas and from 
public and private schools. The general conclusion was that in- 
tensive drill on test items similar to those on the SAT do not pro- 
duce greater gains in test scores than those earned by students 
who retake the SAT after a year of regular hir;h school :<cjruc- 
tion. A second conclusion \v:is that the results of short term 
drills, which can niise performance on some test items, are no: 
retained in the operational rorni of the test. But some scholars 
would conclude that coaching was effective if an intensive 
short program produced the same g An as a year's regular study. 

Coffman (1980). wTiting from a perspective of 17 years 
of experience at the Educitional Testing Senicc, a'calls thou- 
sands of studies on the SAT and concludes that while it is diffi- 
cult to diffea*ntiate teaching from coaching, "there is some 
evidence... that systematic instruction m problem-solving skills 
of the sorts represented b; sat items may improve not only test 
performance but also the underlying skills the test is designed 
to assess" {p. 11). 

Many studies of other instruments support the idea that 
test preparation h:is a positive effect on the academic retention 
of various populations of postsecondary students. Arroyo 
0981) states that Chicano college students have a higher drop- 
out rate than do Anglo-Americans at all levels and notes that 
one factor thought to contribute to this high dropout rate is 
poor academic performance due to lack of learned skills or ed- 
ucational preparation. Arrojo tried to improve the test perform- 
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ancc and increase the class participation of Chicano college 
students by teaching them productive studying skills in prepani- 
tion for testing, Arroyo's coaching procedures were based on 
self-monitoring and self-reinforcen"^nt, alonjj with shaping in- 
structions and reinforcement from a ChJcano program director. 
The results were impressive: students increased the time spent 
studying and improved in both test results and class perform- 
ance, 

Swinton and Powers (1983) studied university students to 
see the effects of special preparation on GRE analytical scores and 
item types. They coached students by offeung familiurixation 
with the test. Their results showed that scores may improve on 
the GRE Aptitude Test following short term interventions b:ised 
on practice on items similar to those found on the test. The 
authors contend that if the techniques learned in coaching are 
rct:iincd, students may improve performance both on Uie ORK 
itself and in graduate school, 

Evans (1977) conducted another study dealing with the 
GRE, using a special course designed to aid black and Chicano 
volunteer subjects in preparing for the exam. Students re'^eived 
four sessions focusing specifically on instruction in the ha^ic 
mathematics required for the test, including strategies for dcil- 
ing with the various <ypes of questions found on the ORll. In 
addition, the course included a short one-se&sion dihcussion of 
the GR*. i^nd its uses that was designed to reduce anxiety Stu- 
dents in the program showed a small but consistent increase in 
GRE Quantity ve scores. The increase was found early in the 
program, and there was no evidence that the program's effec- 
tiveness varied cither by sex or by ethnic group. 

Other stud.^i) that indicate positive results from coach- 
ing involve the National Board of Medical Examiners, The NBMh 
is a standardized test of considerable importance. A passing 
grade on Part 1 is required for graduation from z majority of the 
medical schools in the United States, Weber and Hamer (1982) 
found that students in medical schools that offered or recom- 
mended a review course for Part 1 earned higher scores than 
students from schools that did not. The difference was slight 
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but statistically significant. Scott et al. (1980), over a 3-year per- 
iod, followed 55 second-year medical students who purchased 
a commercial test-coaching service. The students scored signifi- 
cantly higher on the exam than students who had not received 
coaching but who had comparable basic science grade point av- 
erages. While the participants did not think the commercial 
course offered a shortcut to passing the test, they saw the 
coaching as a well organized, condensed review program that 
helped them focus on the most important concepts. 

Naugle and McGuire (1978) documented that Georgia 
Institute of Technology students who attended a workshop to 
prepare for the Georgia Regents' Competency Test achieved a 
10 percent greater passing rate than a sample of students who 
did not attend the workshop. The workshop had a dual pur- 
pose: to increase motivation by pointing out that those who 
failed the test once and made no special preparation for the sec- 
ond time generally failed again and would be refused a diploma, 
and to teach the students how to apply writing skills on the 
exam. The coaching was designed, in part, to produce effects 
by appealing to individual pride and self-interest. 

Two recent metaanalyses look at the effect o*" coaching 
on achievement test scores. Samson (1985) summarized 24 
studies involving elementary and secondary students. Bangert- 
Drowns, Kulik, and Kulik(1983) reviewed 25 studies, mostly of 
secondary and college students. Thirteen studies were common 
to the two papers. Both reports came to surprisingly similar 
conclusions. 

Samson (1985) found that across all types of treatments 
the avenge effect size of coaching was .33- (In other words, 
among all students involved in any type of treatment the aver- 
age gain was .33 standard deviation.) Thus, the average coached 
student moved from the 50th percentile to the 63rd. Bangert- 
Drowns et al. (1983) found similar results. Across all variables, 
the average effect size was .25, representing a gain from the 
50th to the 60th percentile. Both analyses concur in the main 
finding that coaching is associated with significant gains in test 
scores. 
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Both research studies also found the same two second- 
ar>' relationships. The first is that length of treatment made an 
important difference in the effectiveness of a coaching pro- 
gram. In the Samson (1985) study, coaching raised the average 
score from the 50th to the 57th percentile after 1-2 hours, to 
the 64th percentile after 3-9 hours, and back to the 62nd per- 
centile after more than 9 hours. In the Bangert-Drowns et al. 
(1983) summary, the increases were to the 6 1st percentile after 
1-2 hours, the 59th percentile after 3-6 hours, and the 64th per- 
centile after 7 or 8 hours. Apparently, a program of between 6 
and 9 hours is most effective. The general effect of coaching 
seems to be slightly greater for the younger students in the Sam- 
son study. That makes some sense, since the older students al- 
ready have learned how to take tests. But the results of both 
studies agree that coaching can be effective. 

The other secondary effect was type of treatment. For 
Sam!>on(1985), gen^^al test taking skills such as following direc- 
tions, making good use of time, and using answer sheets cor- 
rectly made up the effective program content. Those skills 
would be very appropriate for younger students who did not 
have much practice with objective testing formats. In the 
Bangert-Drowns et al. (1983) study, the effective treatments fo- 
cused not on simple test taking mechanics but on ^'intensive, 
concentrated 'cramming* on sample test questions." The great- 
est gain was found in a single program that included 15-3 hours 
of instruction in recognizing and using the psycholinguistic cue 
system in the flow of language (McPhail, 1977). 

These two reports also had some consistent negative 
findings. Both metaanalyses showed that reducing test anxiet) 
and increasing motivation did not significantly increase scores 
in these samples. Perhaps the results would have bee-^ different 
if the authors had been able to categorize the subjecij> by level 
of anxiety, motivation for school, risk taking, or some other in- 
dividu?' differences. 

Conclusions, Coaching does seem to work. Studies of 
commercial and other coaching courses have implications for 
review programs sponsored by educational institutions. The 
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courses should be consistent with the schoofs curriculum and 
should provide a framework for review of the basic material 
taught. This type of review would be a learning and thinking 
experience rather than simply a crash course or cramming strat- 
egy to pass an exam. In addition to the content review, coach- 
ing should cover specific techniques for the types of items to be 
encountered. Anxiety reduction or motivation enhancement 
should be part of the curriculum if appropriate. 

Test Wiseness 

Test wiseness, like coaching, is a meaningful but often 
misunderstood concept of psychological measurement. In fact, 
the notion of test wiseness is often used as ammunition in the 
battle over the value of objective tei;:ing. The varied and vocal 
opponents of objective testing have claimed that high-scoring 
students may be second rate and superficial, performing well 
because they are merely clever or cynically test wise (Hoffman, 
1962). 

Other, more temporate scholars, analyzing the problems 
of test preparation and test taking, have suggested that lack of 
test wiseness simply may be a source of measurement error. 
Millman, Bishop, and Ebel (1965), who have done extensive 
work in the field, say that **test wiseness is defined as a subject*s 
capacity to utilize the characteristics and formats of the test 
and/or the test taking situation to receive a high score. Test wise- 
ness is logically independent of the examinee*s knowledge of 
the subject matter for which the items are supposedly mea- 
^sures** (p. 707). Millman et al. and Samacki (1979) present re- 
views of the concept and the taxonomy Oi test wiseness. 

Test wiseness is a collection of skills and possibly traits 
that enable certain students to score well, more or less indepen- 
dent of their knowledge of the information being tested. How 
can that happen? Test wise students develop test taking strate- 
gies which they transfer to similar tests. They know how to take 
advantage of clues left in questions by some item writers. They 
know that if they change their answers after some reflection, 
they will generally improve their scores. They never leave ques- 
tions blank when there is no penalty for guessing. 
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Some readers will vigorously question the propriety of 
teaching test wiseness. Should professionals committed to 
strengthening the skills of learning engage in such a seemingly 
inappropriate endeavor? If, as Millman, Bishop, and Ebel (1985) 
suggest, lack of test wiseness is a sou 'ce of measurement error, 
the answer seems to be yes. In fact, leaching all students to be 
test wise should increase test validir . Scores would better re- 
flect the underlying knowledge or skill being tested rather than 
sensitivity to irrelevant aspects of thi: test. Should reading and 
study skills professionals teach theii colleagues how to write 
items that cannot be answered by te:>t wiseness? Again yes. To 
the extent that items are focused, 2.ad all the alternatives are 
plausible, test validity will be increased. The efore, it secns to 
be a good idea to teach both students and nsiructors to be test 
wise. 

Strategies of high-scoring studettts. Some researchers 
have attempted to determine the various strategies used by 
high-scoring test takers. Although Paiil and Rosenkoetter (1980) 
found no significant relationship betv een completion time and 
test scores, they dio find that better sti^dents generally finish ex- 
aminations faster. There were exceptions, however. Some 
poorer students finished early, and sor e high scorers took extra 
time to contemplate answers. High sco -ers seemingly have two 
strategies: know the material well enouj h to go through the test 
very quickly; or go through the test slow ly, checldng, changing, 
and verifying each answer. Either seenu to be an effective ap- 
proach. 

In an effort to determine what tes taking strategies are 
use by A students compared with those ^sed by c and F stu- 
dents, McClain (1983) asked volunteers takik^g a multiple choice 
exam in an introductory psychology coursi to verbalize their 
test taking procedures while taking the exan . She found that, 
unlike the c or F students, the A students coi'Sistently consid- 
ered all alternative answers and read the answe. s in the order in 
which they were presented in the test. They alsc anticipated an- 
swers to more questions than did the lower-scori>ig students. In 
addition, they were more likely to analyze and eliminate incor- 
rect alternatives to help determine the correct ai.swer. The A 



ummvmmmm narinc for and Takinc Tests 



paring for and Taking Tests «^ .i. U 303 



students also skipped more questions they were unsure of (com- 
ing back to them later) than did the c and F students. On a later 
exam, some of the *: and f students who reported using the 
strategies characteristic of the A students reported an improve- 
ment in their exam scores. 

At least some test taking strategies cevelop with age. 
Slakter, Koehler, and Hampton (1970) reported that fifth graders 
were able to recognize and ignore absurd options in test items. 
This is a fundamental strategy, one whose appearance demon- 
strates a developing sense of test wiseness. In ihe same study 
they looked at another basic strategy, eliminating two options 
that mean the same thing. Being able to recognize a similarity is 
developmentally md conceptually more advanced than recog- 
nizing an absurdity. Not surprisingly, these authors found that 
the similar option strategy did not appear until the eighth grade. 
In a study of strategies for taking essay tests, Cirino-Gerena 
(1981) distributed a questionnaire. Higher-scoring students re- 
ported ui/ing the following strategies: quoting books and arti- 
cles, rephrasing arguments several times, rephras.ng the 
questions, and including some irrelevant material in the answer. 
The most common strategy used by all students, however, was 
that of expressing opinions similar to those of the teacher. 

Huck (1978) was interested in what effect the knowl- 
edge of an item's difficulty would have on students' strategy. 
His hypothesis was that students might read certain items more 
carefully if they were aware of how difficult those items had 
been for previous test takers. The study revealed that knowing 
the difficulty of an item had a significant and positive effect on 
test scores. It is not clear, however, how the students used that 
information to improve their scores. 

A fascinating use of prior knowledge has come to light 
with reading tests, Chang (1979) found that a significant num- 
ber of the undergraduate students he tested were able to cor- 
rectly answer questions about passages on a standardized 
reading comprcheiuion test without seeing the text. Some au- 
thors wojld say that i.he question** could be answered indepen- 
dently of the passages. Chang, on the other hand, attributed the 
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students* success to test wiseness. Blanton and Wood (1984) de- 
signed a specific four-stage model to teach studi nts what to 
look for when taking reading comprehension tests, making the 
assumption that students could be taught to use test wiseness 
strategies. 

Other researchers have made the same assumption. 
Sarnacki (1981) urged that medic d students taking the nbme be 
taught a strategy for Type K items. These are multiple choice 
items in which options represent different combinations of pos- 
sible answers. In the student vernacular, this is the "all of the 
above, none of the above" format. Sarnacki observed that Type 
K items are particularly sensitive to one strategy. Regardless of 
the number of alternatives, each must be evaluated separately as 
true or false. Thus, a five-choice item could have anywhere 
from zero to five ^.orrect answers. The student's best strategy is 
to decide whether each singls statement is true or false and then 
select the most correct option (e.g., all oi the above, one of the 
above). But this format is so complex as to be unreliable, 
Sarnacki suggests that either the use of Type K items be re- 
stricted or that students be taught this stnitegy to equalize their 
chances of doing well. 

Some empirical attempts have been made to teach test 
ivisencss strategies. Flippo and Borthwick (1982) taught tcit 
wiseness strategies to their undergraduate education students as 
part of a teacher training program. Each of their trainees later 
taught test wiseness as part of their student teaching. At the 
completion of the treatment activities, they gave each class oi 
children a unit test they had developed. The results showed no 
significant difference between experimental and control 
groups* performance. Focusing on an older population, 
Bergman (1980) tried to teach junior college students to be test 
wise. His treatment group of nonproficient readers was en- 
rolled in a reading and study skills improvement class. The con- 
trol groups either practiced taking tests or received no extra 
instruction or practice. Bergman found i.o significant differ- 
ence in scores on multiple choice and open-ended questions for 
those receiving instruction. It may be that the time devoted to 
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test wiseness instructron in each of these studies was too short. 
Perhaps coaching over a longer period of time would have 
proved more successful. Moreover, strategy effects may be too 
small to be measurable by tests with the reliability typical of stu- 
dent teacher exams such as were used in the Flippo and 
Borthwick study. 

In summary, the identification of test taking strategies 
has been more successful than the attempts to teach them. 
Good test takers instruct themselves in a variety of strategies, at 
least some of which require a certain level of cognitive develop- 
ment. While the idea of teaching tei.1 taking strategies is intui- 
tively acceptable, a few researchers have reported success. 
Perhaps the techniques take a long time to learn. It is also possi- 
ble that individual differences such as personality, anxiety level, 
and intelligence affect how test wiseness information will be 
used. Few studies control for these possible effects. 

Recognizing cues. Another proposed test wiseness skill 
is the ability to make use of cues in the stems or the alternative 
answers by test writers (Millman, Bishop, & Ebel, 1965). Some 
test constructors may, for example, write a stem and the correct 
answer, and generate two good foils. Stumped for a good third 
foil, such a teacher takes the easy way out by rest:iting one of 
the false foils. But a test wise student spots the ruse and rejects 
both similar alternatives. Or perhaps the com ct answer is the 
most complete, and hence the longest. These and other cues 
can take a variety of forms, and can be found in a variety of test 
types, including multiple choice, true/false, matching, and fill- 
in-thc-blank. 

There is an interesting body of literature investigating the 
effects of using cues to c<.>rrect answers. An illustrative example 
is the w^ork of Huntley and Plake (1981), who investigated cues 
provided by grammatical consistency or inconsistency between 
the stem and the set of alternatives. They focused on singular/ 
plural agreement and vowel/cor onant clues. A stem might 
contain a plural noun that could give a clue to the correct an- 
swer if any of the alternatives did not have agreement in num- 
ber. A stem ending in '*a'' or "an" might also provide a clue to 
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the correct choice depending on whether the alternatives beg^n 
with vowels or consonants. The authors found that there was 
some cueing; with these patterns and recommended that test 
makers wrLc multiple choice items to avoid grammatical aids. 

Otiiec cues have to do with the position or length of the 
correct ans\^er. Inexperienced test writers have a tendency to 
hide the correct alternative in the B or C position of a multiple 
choice alternative set, perhaps thinking that the correct choice 
will stand out in the A or D position and be too obvious. Jones 
and Kaufman (1975) looked at the position and length of alter- 
natives on objective tests to determine their effects on re- 
sponses. They found that the students involved in their 
research project were more likely to pick out a correct response 
because of its B or C position than because of its length in rela- 
tion to the other choices. Both cues had an effect, however; ap- 
parently some students are alert for he possibility of such cues. 

A study by Flynn and Anderson (1977) investigated four 
types of cues and their effects on students' scores on tests mea- 
suring mental ability and achJcvcnient. The four cues were (1) 
options that were opposites, so that if one were correct, the 
other would be incorrect (e.g., "the war started in 1812" versus 
"the war ended in 1812''); (2) longer correct options; (3) use of 
specific determiners; and (4) resemblance between the correct 
option and an aspect of the stem. The undergraduate subjects 
were given a pretest of test wiseness and classified as either test 
wise or test naive. Then instruction was given for recognising 
the four cues. The students showed no gains on the ability and 
achievement tests, although the students who were classified as 
test wise did score higher than those classified as test naive. Per- 
haps those students who were originally labeled te^^t wise used 
test taking strategies other than the ones measured, or were 
brighter or better guessers. It is also possible that the target cues 
were not present in t'^^* ability and ^Jchievement tests. In any 
case, it seems that the more test wise students were more effec- 
tive in applying some strategies to various testing situations. 

Two studies focused on technical wording as a cue. In 
one, Strang (1977) used familiar and unfamiliar choices that 
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were either technically or nontechnically worded He 3^ked 
students, in a somewhat artificial situation, to guess on each 
item. He found that nontechnically worded options were cho- 
sen more often than technically worded items regardless of fa- 
miliarity. In the second study, Strang (1980) used questions that 
required students either to recall or to interpret familiar content 
from their child growth and development course. The items 
contained different combinations of technically and nontechni- 
cally worded options. The students had more difficulty with 
recall items in which the incorrect option was technically 
worded. Strang suggested that this difficulty might spring from 
students' tendency to memorize technical terms when studying 
for multiple choice tests. They would thus use technical words 
as cues to a correct choice. 

Smi:h (1982) made a subtle contrib uiion to the te^st vise- 
ness cues -esearch with the notion of convergence. He points 
out one of the principles of objective item constru^-tion: every 
distractor must be plausible. If it isn't, it contributes nothing to 
the value of the item as measurement. Smith offers the follow- 
ing example of implausibility: 

Who was the seventeenth PrcMoent of the United States? 

a. Andrew Johnson 

b. 63/8 

c. 1812 

d. A Crar/ Day for Sally 

Clearly, foils need to be plausible if the item is to discrim- 
inate between students who know the content of the test do- 
main and those who do not. However, the requirement that 
foils be plausibly relateu to the stem creates a problem. Many 
test writers generate a stem first, and then the correct answer. 
To build a set of plausible foils, they consider how the correct 
answer relates to the stem. To use Smith (1982) again, suppose 
"Abraham Lincoln" is the correct answer to a history question. 
Most likely, the question has something to do with either Amer- 
ican presidents or personalities from the Civil War era. So a 
plausible set of alternatives might include those two dimen- 
sions. Alternatively, it could include people from Illinois or men 
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with beaids. Using the first possibility, a set of alternatives 
might be: 

a. Abraham Lincoln 

b. Stephen Douglas 

c. Robert E. Lee 

d. James Monroe 

Smith suggests that test wise students look for the di- 
mensions that underlie the alternatives. In this ca:^'* the dimen- 
sions are: 



Civil War 
Personalities 



Presidents 




Douglas 
Lee 



Lincoln is the oni> alternative on which the two dimensions 
converge. 

Smith (1982) reports a number of experimental studies 
to test the use of the convergence cue. Leary and Smith (1981) 
gave graduate students in education some instruction in rccog- 
nizing dimensions and selecting the convergence point. Then 
they gave students items from the abstract reasoning section of 
the Differential Aptitude Test, the verbal section of the SAT, and 
the Otis Quick Score Mental Ability Test They asked the stu- 
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dents to find correct answers without seeing the stems. Subjects 
scored significantly better than chance on all three tests. It ap- 
pears that convergence can be a usable cue. 

Next, Smith (1982) randomly divided a group of high 
school students and gave the expep'mental group 2 hours of in- 
struction in finding the convergence point. The control group 
had 2 hours of general test taking instruction. Both groups had 
previously taken the Preliminary Scholastic Aptitude Test (psat) 
and took the sat after the experiment. The mean for the experi- 
ment group, adjusted for the psat covarute, was 39 points 
higher on the verbal subscale. Smith believes that convergence 
training is the explanation of the findings. 

Test wiseness does seem to be due, in part, to sensitivity 
to certain cues in the items. Some of the cues arc obvious to 
those who arc familiar with the grammatical conventions of the 
language. The cue effect of familiar technical words is another 
example. Other cues, like position and length of the corrcct an- 
swer, seem to be the rcsult of rcpeated exposure to the various 
foi*ns of objective test items. The cues based on the logical rela- 
tionships between alternatives arc probably of :i different sort, 
and may depend on the test takers' general intellectual ability or 
other characteristics. With that possibility in mind, it is interest- 
ing that studies have achieved positive rcsulis in teaching so- 
phisticated cue use. While it is hard to cleanly separate cues 
from strategy, it does seem that the cue approach to teaching 
test wiseness is more effective. 

Changing answers. There is a false but persistent notion 
in the test taking field that a student s first answer is likelv to be 
correct. The implication is that one should stay with iiic iirst 
choice, since changing answers is likely to lead to a lower score. 
Contrary to this belief, research indicates that changing answers 
produces higher test scorcs (Edwards & Marshall, 1977, Lynch 
& Smith, 1975; McMorris & Leonard, 1976; Mueller & 
Schwedel, 1975; Smith, Coop, & Kinnard ^^79). These studies 
confirm earlier rcsearch findings that changing answers is, in 
fact, a mark of test wiseness. The rcsearch on this point is re- 
markably consistent. 
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To begin, it should be clear that answer changing is not a 
random event. Lynch and Smith (1975) found a significant cor- 
relation between the difficulty of an item and the number of 
students who changed the answer to that item. They suggested 
that other items on the test may have helped the students re- 
consider their answers for the more difficult items. It seems 
possible that changes produce higher scores because later items 
help students recall information they did not remember the first 
time through. Two studies looked into the answer-changing 
patterns of males and females (Mueller & Schwedel, 1975; l'<-*n- 
field & Mercer, 198Q). Neither found a significant difference in 
scoiie gains as a fxmction of the bcx of the test taker. For the most 
part, higher-scoring students gained more points by changing 
answers than their lower-scoring colleagues (Mueller & Schwe- 
de*; Penfield & Mercer). Only one study (Smith ct al., 1979) 
found that the lower-scoring group benefited more from their 
answer changes. In general, the higher-scoring students made 
morx: changes (Lynch & Smith; Mueller & Schwedel, Penfield & 
Mercer). 

McMorris & Leonard (1976) looked into the effect of 
anxiety on answer-changing behavior and found that low-anxi- 
ety students tended to change more answers, and to gain more 
from those changes, than did high-anxiety students. But both 
groups did gain. 

In writing about the answer-chaiging research, Wilson 
(1979) cited many of the same findings already discussed. She 
reiterated the main concern of most of those researchers, that 
stud'^nts should know the true effects of answer changes 
(Edwards & Marshall, 1977; Lynch & Smith, 1975; Mueller & 
Schwedel, 1975; Smith et al., 1979). It seems that changing an- 
swers is a good test strategy wnen, after some reflection or a 
review of previous responses, the student thinks changing is a 
wise idea. In gene al, the low-anxiety, high-scoring students 
both make more changes and benefit more, in spite of contrary 
belief. 

Retesting. A final area of research delves into the effects 
of simply repeating a test in thf. original or panJlel form. The 
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second score will reflect a number of effects: regression to the 
mean, measurement error, and the increased information 
gained by study between tests. But part of the difference will be 
due to a type of test wiseness. An instructor may give several 
tests during a course, and students may begin to see a pattern in 
the types of questions asked. Besides giving students some di- 
rection for future test prt;paratior», this may help them develop 
a certain amount of test wiseness. Can the effects be general- 
ized? The research on retesting starts with the premise that the 
actual taking of the test helps students develop certain scrategies 
for taking similar tests at a later time. Some of the retesting re- 
search involves typical classroom exams. Other studies cover 
the effects of repeated testing on standardized measures of intel- 
ligence, personality, or job admission. 

Studying classroom tests. Gates (1982) investigated 
whether retesting would improve mastery and retention in un- 
dergraduate courses. The study sample included l42 students 
from five different sections of educational psychology taught 
over a 3-year period. Of the 202 retests taken to improve an 
original score, 139 (or 68.8 percent) showed improved per- 
formance. The mean gains in tested performance ranged from 
1.2 percentage points to 6.3 percentage points. The author 
notes that the students frequently took retests 2 to 4 weeks after 
the original test date, suggesting that distributing tebt practice 
may be an effective strategy in increasing knowledge of the sub- 
ject material. Howe\'er. the gains arc rather modest. 

Allowing that retesting can produce seme grains, arc the 
gains specific to the content of the rcte^^ted items, or do they 
constitute a type of general test wiseness? Bondy (1978) found 
that reviewing specific questions from a multiple choice test im- 
proved students* performance on a retest involving those spe- 
cific items. Mowevcr, the students who had reviewed those 
questions scored no better on reworded items than did students 
who had not reviewed the questions and answers. Simple re- 
testing does not seem to be \ er) effective if the item wording is 
changed. 
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A study done by Tips and others (1978) indicates that 
retesiing may improve test scores. The study was done with 55 
college students who were enrolled in a noncredit reading im- 
provement cout5e. The purpose of the study was to record the 
effects of an instructional unit on taking analogy tests. The 
results showcv, that college students cnn improve analogy test 
performance with instruction on a test pa'panilion stnitegy. 
However, the instmction may be no more effective than the 
practice effects of rctesting. 

For classroom testing, it seems, the results are not very 
exciting. Simple test-ng and retesting, without some explicit test 
wiseness instruction, have little to recommend them. What 
about the effect of simple retesting on more standardized tests? 
Various types of tests have been studied in the research. Catron 
and Thompson (1979) looked into gains on the Weschler Adult 
Intelligence Scale. Using four test-retest intcr^'ab. they found 
that regardless of the time between the original test and the re- 
test, the gains on the performance IQ section were greater than 
the gains on the verbal IQ section. The rcsearcbcrs believe that 
the experience of taking a test alters the rtoults of any similar 
tests taken ifterwards. One would not expect rctesting to alter 
basic traits. Hess and Neville (1977) studied retest effects on 
personality tests using the Personality Research Form. Their 
results led to the conclusion that what SMbjecis learn or think 
abopt after seeing their test results affects t iturc scores on a per- 
sonality test. Thus the inten^ening event, not the retesting. is 
whai is powerful. 

But still the question remains; Can retesting affect scores 
on basic characteristics? Wing (1980) did a stud> using a multi- 
ple abilities test batter) in use nationwide since 1974 as an en- 
trance criterion for federal professional ^nd administrati\e 
occupations. The major concern of the study was to see 
whether practice would aid test repeaters. During the first 3 
years, ak.^Anate forms of the test hatter)' were administered on 
17 occasions to 600,000 subjects, with a little less than ^ per- 
cent of these subjects taking the test batter) two or moa* times. 
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The findings are that score gains depended on age, gender, and 
the number of previous testings. Older test takers averaged 
lower gains than younger test takers. Wing also found a differ- 
ence in subtest gains by sex. Compared with scores for males, 
the average gains for females were higher in inductive reason- 
ing, the same in verbal ability and deductive reasoning, and 
lower in judgment and numerical items. Applicants with lower 
initial scores repeated the test more often. Higher final scores 
were recorded by those who repeated the battery the uiost 
times. It seems unlikely that .:ores on these tests could be im- 
proved by study of the content. The improvement is probably 
at least partly due to test wiseness gained from simple retesting. 

Naugle and McGu;re (1978) make an interesting and per- 
tinent observation: Several students, when interviewed, said 
they did not prepare for the Georgia Regents* Competency 
Exam because it cost nothing to take and because failures were 
not recorded on their records. Therefore, they could continue 
to retake the test until they passed it. The data support this idea. 
In the summer of 1978, 25 percent of all students taking the 
Regents' E* m were repeaters, and many passed with no addi- 
tional help Mnce taking it the first time. It seems that familiarity 
with the test, due to repeated retesting, aided them in passing 
the test. 

In summary, it seems that retesting, without any explicit 
content tutoring, can have poi;itive effects on certain scores. 
However, the studies which show effects allow for repeated re- 
testing. Perhaps the gain is due in part to regression upward to- 
ward the mean, and in part to a test-specific type of test 
wiseness. 

Conclusions. The literature on test wiseness seems to 
support several conclusions. Some strategies have been identi- 
fied for helping on essay and multiple choice tests, especially 
Type K items. Avoiding absurd options and rejecting options 
that mean the same thing are common strategies. Probably one 
part of any strategy is recognizing the presence of certain cues 
in the test items, such as grammatical agreement, length, con- 
vergence, and technical wording. Students who are test wise 
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can recognize these cues and may implicitly use them when the 
situation allows it. Almost all students, regardless of level of 
anxiety and test wiseness, can improve their scores by changing 
answers as they work. And simple retesting, even without any 
formal review of content, has a small but positive impact on 
scores. 



Test Anxiety 

One of the major problems students face in taking t(!Sts is 
test anxiety. Test anxious students often earn lower scores on 
classroom tests than their ability would predict. The highly anx- 
ious student may have done a creditable job of preparation, us- 
ing all the appropriate study techniques. Up to the moment of 
the exam, the student may be able to summarize and report 
content and demonstrate other necessary skills. But in the ac- 
tual test situation, when it counts, this student fails to perform. 

The typical test anxious student may show distress in 
one or more of the following ways: physiologically (excessive 
perspiration, muscular tension, accelerated heartbeat), intellec- 
tually (forgetting, incorrect response fixation), or emotionally 
(worry, self-degeneration). After the exam has been turned in, 
the test anxious student repon** i rush of recall, after it is too 
late to change answers. Gaudry and Spielbergc ^971) suggest 
that as many as 20 percent of a given college sample may suffer 
from severe and debilitating test anxiety. 

Test anxiety, as a scientific concept, is approximately 40 
years old (Mandler & Sarason, 1952). In their initial investiga- 
tions, Mandler and Sarason asked students about their feelings 
and performance while being evaluated. Questions covered in- 
creases in heart "^te, perspiration, feelings of uneasiness, and 
worry. From the responses, the authors computed a score of 
testing-produced anxiety They found that students who had 
high levels of anxiety worked slower and showed more overt 
signs of anxiety on a block design test that was presented as a 
measure of academic aptitude. After completing six trials, the 
students were randomly told they scored either very high, 
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about average, or ver-' 'o«v. They were then asked to complete 
another six trials. 

Specific findings from the second trial were linked to 
level of test anxiety. On the second series, the high-anxiety stu- 
dents showed depressed scores, regardless of their previous per- 
formance. It seems that these students collapsed under the 
pressure of further evaluation. For the low-anxiety students, 
however, further testing led to an improved performance. They 
were energized and worked fasten The effect was particularly 
str"*^g for those low-anxiety students who were told they had 
done very poorly on the earlier test. 

To account for those effects, Mandler and Sarat *n (1952) 
hypothesized two mechanisms chat produced the anxiety-re- 
lated deficit. In the psychological language of the day, they 
talked of two learned drives— one for task performance and the 
other for anxiety. In an evaluation situation, both drives oper- 
ate. The * learned task drive** elicits useful and score-enhancing 
feelings of competence, accurate recall, and rapid, skilled per- 
formance. The ^learned anxiety drive,** in part, brought on the 
same effect. But the anxiety drive also elicited task-interfering 
fcdings of inadequacy, memory blocking, helplessness, and ex- 
cessive questioning. In the high-anxiety student, these two 
drives conflict and produce lower scores. 

All of these feelings and thoughts, positive and negative, 
presumably were learned in the past, as the student was grow- 
ing up and being evaluated by parents and teachers. Later, in a 
college testing situation, all the old learning came back when 
stimulated by evaluation. The net effect, which was predicted 
and then validated by research, is that as the test becomes more 
important and negative evaluation becomes more damaging, 
learned anxiety drive becomes stronger and has more destruc- 
tive effects. Highiy anxious students may flunk because of their 
anxiety, not because they do not know the material. 

Since the classic work by Mandler and Sarason (1952), 
the investigation of test anxiety has blossomed. Reviews by 
Allen (1971), Allen, Elias, and Zlotlow (1980), Tryon (1980), 
and Wildemouth (1977) attest to the theoretical and empirical 
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growth of the field. A recent metaanalysis (Hembree, 1988) cov- 
ered 562 high-quality studies. A volunrie edited by Sarason 
(1980) details work on a variety of special fields including the 
development of test anxiety in children, the physiological base 
of test anxiety, a variety of intervention models, and the impact 
of test anxiety on math and on computer-based learning envi- 
ronments. Much of the research has been aimed at understj. id- 
ing the dynamics of test anxiety treatment, reducing subjective 
discomfort, and improving academic performance. In this sec- 
tion we focus specifically on those treatment techniques that 
have been shown to improve grades among college students. 

Measurement and theories. As a prelude to a survey of 
treatment techniques, we present a brief overview of the mea- 
sures and theories of test anxiety. The first instrument for mea- 
suring test anxiety, the Test Anxiety Questionnaire (Mandler & 
Sarason, 1952), contained 42 questions. Participants were asked 
to record their responses to each item by placing a mark on a 
horizontal line. The more discomfort they felt, the further to 
the right they made their checkmark. To score an item, the ex- 
perimenter measured the number of centimeters from the left 
edge of the line to the check — a very unwieldy procedure. A 
more usable instrument was the Test Anxiety Scale (Sarason, 
1978), a 37-item instrument covering most of the same experi- 
ences but in a much more convenient true-false scoring format. 
An earlier l6-item true-false Test Anxiety Scale (Sarason & Gan- 
zer, 1962) is an excellent instrument for screening a large class. 
Vi^rk and Bennett (1981) have normed the scale for high, me- 
dium, and low achievement students. 

Several significant trends have arisen in the development 
of test anxiety measures. One such development grew out of 
the work of Liebert and iMorris (196?). They hypothesized that 
test anxieiy had two components. (1) physiological and emo- 
tional arousal, such as increases in heart rate, perspiration, and 
muscular tension (tl: common overt symptoms of anxiety), 
and (2) worried thoughts about the negative consequences of 
failure, about doing poorly, and about lack of skills (conscious, 
internal talk that interfered with /oaipetent performance). 
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When they did a factor analysis of the Test Anxiety Question- 
naire, Liebert and Morris did indeed find these two factors, 
which they distilled into a short 10-item test called the Worry- 
Emotionality Questionnaire (Morris & Liebert, 1970). The two 
factors have very different effects on test taking. 

Emotionality, or excessive physiological arousal, may or 
may not be detrimental to student performance. Some level of 
arousal is absolutely necessary for a student to learn, retain, and 
perform. The optimal level of arousal for any given task de- 
pends on a person's history, physiology, and state of health. If 
emotionality goes beyond that optimal level, performance may 
begin to deteriorate. But emotionality is not a universally nega- 
tive variable. 

Worry, the other factor, is seen as always being detrimen- 
tal to test performance. The high-anxiety student has internal 
responses that interfere with optimal test performance. 
HoUandsworth et al. (1979) have cleverly documented the 
kinds of internal statements made during a test by high- and 
low-an.:iety students. Calm people recall themselves saying 
things like **I was thinking this was pretty easy." *'I was just 
thinking about the questions mostiy," or "I always love doing 
things like these little designs.*' Their comments contrast 
strongly with those recalled by anxious students: '*I decided 
how dumb I was,'' or ''My mother would say. . .don't set bad 
examples because Vm watching you " These internal statements 
may reduce performance by interfering with task relevant 
thoughts, and may also increase emotionality 

Another important theory about variables ?i'fecting test 
anxiety was put forward by Wine (1971), who noted the impor- 
tance of how students direct their attention. According to her 
analysis, calm students pay most attention to test items. Anx- 
ious students, on the other hand, attend to their internal slates, 
their physiological arousal, and especially their negative self- 
talk. In essence, high-anxiety students are focusing their atten- 
tion internally rather than externally to the examination. Wine 
was able to reduce test anxiety effects by showing students how 
to attend to the test, and not to their internal states. 
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We have only touched on the trends in test anxiety mea- 
surement here, summarizing the points that have implications 
for practice. The literature in this field is both extensive and 
quite technical. Interested readers should consult Sarason 
(1980) or Gaudry and Spielberger (1971). 

In summary, there are three general approaches to test 
anxiety. The physiological or behavioral approach stresses the 
disruptive effects of arousal and emotionality. Treatment is 
geared toward helping students relax and desensitizing them to 
their presumed phobic fear of tests and evaluations. The second 
approach flows from the worry or cognitive component of test 
taking. Students are taught how to change the way they think 
and talk about themselves in a test situation. The third approach 
involves teaching test anxious students to focus on the exam, to 
use good test taking skills, and to ignore, for a while, the inter- 
nal distractions of tension. 

Reducing emotionality. The most common technique 
for re*, ^cing emotionality and physiological arousal is relaxa- 
tion and desensitization (Wolpe, 1969). In varying numbers of 
sessions, students are first taught how to use deep muscle relax- 
ation Oacobson, 1938). In tha^ relaxed state, they are asked to 
imagine themselves in increasingly difficult situations. Students 
might be asked to imagine themselves studying a week before 
the exam, and to hold that scene in mind until they are quite 
comfortable with it. Then they would be asked to imagine 
studying the night before the exam, and to get comfortable 
with that idea. Succeeding mental images would involve the 
morning of the exam, walking to the exam, receiving the test, 
and taking the exam. Desensitization can be more effective than 
simple relaxation or no treatment at all (Aponte & onte, 
197 1). The desensitization may be done in massive doses rather 
than spread out over several days (Dawly & Wenrich, 1973). Or 
the students may be exposed only to the most feared items in 
the hierarchy; for instance, ''Imagine that you have just re- 
ceived your test booklet and you can not recall the answer to a 
single question.'' The technique of asking a relaxed student to 
imagine the most anxiety-provoking situation is called iyyiplo- 
sion (Cornish & Dilley, 1973). 
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In general, simple relaxation, system itic desensitization, 
and implosion techniques have not been shown to be strikingly 
effective in reducing test anxiety. In her review, Tryon (1980) 
stated that systematic desensitization and/or implosion resulted 
in significant academic improvement for participants relative to 
no-treatment controls in only 7 of 17 studies. Another review 
(Allen et al., 1980) showed improvement in 22 percent of the 
reviewed studies. In general, it is fair to sa}' that systematic de- 
sensitization worked in about 30 percent of the recorded stud- 
ies, and those studies tended to be methodologically flawed in 
that they often did not conuin a credible placebo procedure to 
control for nonspecific treatment effects. 

One theoretically important refinem'snt in the emotion- 
ality control research has demonstrated a high percentage of 
grade improvements. Instead of leaving control with the thera- 
pist, students are given more responsibility. Subjects are taught 
specific techniques to adjust their own level of relaxation. They 
might practice saying the word calm and pairing it with a re- 
laxed state. Then, in a test situation when they say the word 
calm to themselves, the cue helps them relax and reduce the 
effects of anxiety (Russell & Sippich, 1974). T'lbjects also have 
been laught to control their own desensitization with good 
results (Denny & Rupert, 19771 Giving subjects control over 
relaxation seems desirable. Tryon (1980) reports that four of the 
five studies in which subjects had conscious control over relax- 
ation led to significant grade improvements (Deffcnbacher, 
Mathis, & Michaels, 1979; Delprato & DeKraker, 1976). 

Rediicmg worry. The generally higher effectiveness of 
client controlled desensitization leads naturally tO a discussion 
of the research on cognitive interventions. These procedures, 
flowing from interpretations by Wine (1971), deal with the 
worry component of test anxiety. Hollandsworth et al. (1979) 
documented the kinds of things high-anxiety students say to 
themselves during a test situation. Cognitive therapy techniques 
were developed to counter those negative, worrisome 
thoughts. Cognitive therapy techniques go beyond desensitiza- 
tion. Clients are taught to use coping imagery in which they 




Wark and Flippo 



imagine themselves reducing their tension, solving their prob- 
lems, and being successful. Note the difference between emo- 
tion oriented and worry oriented therapy. With desensitization 
for emotionality, the clients relax and imagine themselves being 
comfortable in progressively more difficult situations. The ther- 
apist is generally in charge, and the focus is on the emotional or 
physical component of test anxiety In a cognitive therapy ap- 
proach for worry, clients imagine chemselves actively taking 
steps to reduce the negative effects of anxiety. They might imag- 
ine themselves taking slow, deep breaths, becoming calm, and 
giving themselves successful instructions. In a cognitive ap- 
proach to alleviate test panic, students \'ould see themselves 
start to check the time, skim over the entire test, skip difficult 
items, and recall material from a chapter that contains the an- 
swer to a question. In essence, clients are taught to imagine 
themselves going through a therapeutically effective checklist 
of activities. 

'^*^e results of the earliest s-udies of cognitive therapy on 
test a.ix.ety were very encouraging. Meichenbaum (1972) 
taught test anxious ,.tudents to be acutely aware of their nega- 
tive self-verbalization and instruction. He also modified the 
standard desensitization procedures so that instead of just imag- 
ining themselves relaxing, students were taught to give them- 
sel es support statements and instruction in relaxation. The 
students in Meichenbaum 's cognitive modification group made 
significant gains in grades. Holroyd (1976) found essentially the 
same result. His cognitive therapy group received training to be 
more aware of their negative internal self-talk and to prompt 
themselves to react well in stressful situations. 

In her review, Tryon (1980) found that of four cognitive 
intervention studies monitoring academic performance, two 
showed significant grade improvement from cognitive therapy 
work. In review of later test anxiety studies, Lent (1984) looked 
for grade change effects as a result of cognitive therapy. Of 
seven methodologically acceptable studies using some sort of 
cognitive intervention, he found only two that showed im- 
provement in GPA. And both of those studies (Kirkland & 
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Hollands worth, 1980; Decker & Russell, 1981) used a treat- 
ment that involved study skills training as well as cognitive ther- 
apy. In fact, in the Decker and Russell study, cognitive 
restructuring and anxiety reduction were less effective than 
study skills counseling in improving grade?. It would appear 
that cognitive restructuring iv. -attack the wcrry component is 
not a great deal more effective than the desensitization tech- 
niques used to attack emotionality when grade change is the 
target of interest. That leads to another possible area, the use of 
study skills training as a technique for attacking test anxiety. 

Improving study skills. Reducing test anxiety by im- 
proving study skills is not an either/or approach. The literature 
illustnites the effectiveness of a combination of treatments. Al- 
len (1971), working with a group of anxious, high-achieving 
college students (mean pretrcatment gpa, 3*5), found that the 
must effective treatment involved systematic dcbensitization 
combined with study skills training. The skills content was 
based on the classic sq3R text study strategy (Robinson, 1946). 
In addition, students- were taught behavioral techniques for 
monitoring time, charting rate, and giving self-reinforcement. 
The students in the combination group improvec^ their course 
examination percentile by 24 percent. Similar results were re- 
ported by Mitchell and Ng (1972). They found the greatest im- 
pact from combining techniques. Each of the nine sessions they 
offered the it ^ treatment group covered relaxation, desensi- 
tization, and skills work. Finally, iMitchell, Hall, and Piatkowsia 
(1975) found that a combination of study skills instruction and 
systematic desensitization was more effective than either stucy 
skills plus relaxation training or intensive stud) skills instruc- 
tion alone. On a 2-year follow up, 73 percent of the students 
given desensitization plus study skills training were still in col- 
lege, while only 25 percent of the relaxation group were still 
enrolled. 

Later research has uncovered refinements to the general 
conclusion that a combination of techniques is effective. Brown 
and Nelson (1983) studied a sample of high-anxiety college stu- 
dents, all of whom scored above the 67th percentile on the Test 
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Anxiety Survey (Sarason, 1978). Part of the group consisted of 
low achievers (GPA less than 2.7) and part consisted of high 
achievers (GPA greater than 33). The two subgroups differed in 
important ways. The high achievers knew more about good 
study skills. In addition, they were better abie to stop their own 
negative self-descriptions during an examination. In a sense, 
they could handle their anxiety. The low achievers, on the 
other h^nd, lacked both information on study skills and the 
ability to counter their negative thinking Naveh-Benjamin, 
McKeachie, and Lin (1987) also found two categories of test 
anxious students. Both types had trouble recalling material for 
an exam, but one type had good study skills and the ?bility to 
encode and organize materials in a way that matched the lectur- 
er's structure, while the other type had trouble with encoding, 

Covington and Omelich (1987) also studied types of 
highly anxious students and the ways they studied. The authors 
investigated the presence of anxiety blockage on both easy test 
items calling for recognuion and difficult items measuring the 
ability to m2':e genemlixaiions or inferences. They found that 
high-anxiety students who used good study habits suffered 
some interference, but only on difficult items. Using a path ana- 
lytic technique to partition the causal determinants of blockage, 
they estimated that the causal effects on test performance due 
to anxiety (7.34 percent) were greater than the effects due to 
study skills (1.05 percent). (The main determinant of est per- 
formrince was intellectual ability, at 91.6 percent.) 

Thus, Brown and Nelson (1983), Covington and 
Omelich (1987), and Naveh-Benjamin et al. (198:^) all agree that 
there are subcategories of high-anxiety students,. In terms of 
treatment, some may need study skills assistance, some ma) 
need cognitive control training, and some may need both. 

There is one contrary finding regarding study okiil: treat- 
ment. In a second study, Allen (1973) gave a ^^roup of high- 
anxiety students training in deep muscle relaxation with and 
without behavioral stud) skills counseling. Again the skills 
counseling was based on sq3R, augmented b) beha\ ioral self- 
control techniques. Surprisingly, Allen found no differences be- 
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tween the two groups. Students in both groups improved their 
exam scores and their gpas more than the nontreated control 
group. For those highly anxious students, simply learning to re- 
lax and reduce arousal seemed to be as important as learning 
new study skills. 

What can be said about the use ot siudy counseling as a 
way to reduce test anxiety? Clearly, a behavioral :ippix)ach to 
study skills improvement is an important variable in reducing 
test anxiety and raising gnides (Hcmbree, 1988). Tryon (1980) 
concludes that packages that include study skills plus some 
other kind of intervention always show better results than no- 
treatment control groups. Deciding which type of student 
needs which type of treatment is a worthwhile subject of 
rcsearch. 

Other treatment techniques. Several other methods for 
reducing test anxiety have been investigated. For the most part, 
they do not flow from any of the three previously discussed ap- 
proaches. Rather, they seem to come from other aspects of psy- 
chological research. Observation learning from a model student 
is one example. Home and Matson (1977) had a group of high- 
anxiefy students listen to a series of tapes purporting to be 
group i:ess ions of test anxious patients. Over the course of a 10- 
week treatment, students heard three tapes, in which the model 
students expressed progressively less concern about test panic. 
During the sessions in which no tapes were played, counselors 
verbally reinforced the subjects' nonanxious self-reports. Stu- 
dents in other groups were treated by deseiisitization, floodmg 
(asking students to imagine test failure), or study skills counsel- 
ing. Home and Matson found that modeling, desensitization, 
and study skills training were more effective than flooding in 
producing grade improvements and reducing anxiety. On the 
other hand, McCordick et al. (1979), comparing modeling with 
cognitive treatment and study skills, found that no treatment in 
their study was effective in improving grades. As these research- 
ers admit, "the ideal treatment for test anxiety is still elusive" 
(p. 420). 
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NX'orking from a general anxiety theory stance, Bushkiell 
(1978) investigated several ingenious approaches to reducing 
test anxiety. If, he .speculated, higb anxiety students are sensi- 
tive to any stimulation that increases concern fo. evaluation, 
why not try reducing such stimulation? He had high-anxiety 
students take mid-quarter exams either in a large lecture hall 
where they saw other students or in a language lab where the} 
were screened off from one another. He found that gnideb were 
significantly higher in the lab for both high- and low-anxiety 
students. For the high-anxiety students, the difference was 
marked. He also found that among mildly anxious students, 
those who sat next to highly anxious students earned lower 
scores than those who did not, regardless of test setting. 

Clearly, the research niises some interesting questions. Is 
the positive effect of the lab setting due :o a adduction of visual 
distraction, or to the novelty of taking a test in a special place? 
The fact that the marginally anxious students were a* ccted b) 
the presence of anxious students, even in the lab, suggests that 
more than just visual separation is responsible for the test score 
gains. While all the questions have not been ansv wd, the dat:i 
certainly do suggest interesting ways to reduce uie effects of 
test anxiety. 

In another facet of this field, there is fascinating and con- 
sistent literature on the impact of allow ing students to express 
their feelings about a test, McKeachie, Pollie, and Speisman 
(1955) presented tests with a special answer sheet that had 
space to comment about an) item. The students who recei\ed 
sheets with a comment section earned higher scores than the 
students who used conventional answer sheets. Smith and 
Rockett (1958) replicated the study but extended the effect. 
They used three groups of students, one given suindard answ er 
sheets, one given sheets that allowed for comments, and one 
that conuiined the message, Tlease Lomment on an) thing unu 
sual about each questi^'^n." They found that the three types of 
answer sheets were /sociated with successively better test 
scores by high-anxiety students, and successivel) worse scores 
by low-anxiety students, Wh) does an in\ itation to Lomment 
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about a test reduce a^.xiety effects for anxious students? Per- 
haps because the momcntgr two taken to write out any feelings 
about the item reduoiS some of the worry about the test. Stu- 
dents may feel that they have explained their answers, so they 
can stop worrj^ing. Perhaps they leel that witl: the explar^ation, 
graders will give them the benefit of the doubi. Unfortunately, 
for the low-anxiety students, the invitation to comment seemed 
to lower motivation and drive. 

Conclusions, What can we conclude about test anxiety? 
The most restrictive position, best exemplified by Kirkland and 
HoUandsworth (1980), is that educators would be better off 
scrapping the concept entirely. They believe that as far as test 
performance and grades are concerned, inadequate perform- 
ance simply indicateb ineffective test taking. Their conclusionb 
are based on studies conducted with simple anagram taskb. 
Traininft in academic test taking skills did seem to be more effec- 
tive than either relaxation to reduce emotionalitj or meditation 
to reduce worry. But while anagram tasks are good a-search 
tools, they are oot real world learning tasks. 

What about more realistic measures? When performance 
is measured in OPA chan£/*, the Kirkland and HoUandsworth 
(1980) study showed that meditation was just as effective ab 
stud> skills instruction, although relaxation was i.ot as effec- 
tive. These findings fit with the more liberal conclu;>ion in the 
general literature that treatment invohing b>btematic dcsenbi- 
tization, or bf,udy skillb training plub bomc cognitive inter\'en- 
tion, is effective in producing grade ch.Miges (Denney, 1980; 
Hembrcc, 1988; Tr>'on, 1980). 

That conclusion may change in time. Psychological 
techniques, like pest controx chemicals, beem to lobe their im- 
pact through succebsive generations. But for now, the real prob- 
lem of tebt anxiet} beemb to be bebt treated bj teaching .students 
better ways to btudy and take tebts as well ab methods for exert- 
ing active self-control over their ov. , process of preparing for 
and taking exams. Of course, instruc.o:- -m make some envi- 
ronmental changes to reduce test ati\*cty effects. Bushnell 
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(1978), McKcachie et al. (1955), and Smith and Rockctt (1958) 
point the way to techniques that deserve more consideration. 
Teachers who do their best to reduce tension, project hope and 
kindness, and model efficiency rather than panic are aJso exer- 
cising good preventive counseling. The real challenge i;» to find 
and manipulate v^ys to separate and individualize programs .*o 
that activities that are effective for high-anxiety students do POt 
penalize low-anxicty ones. 

Implications for Practice 

We have reviewed three aspects of the process of prepar- 
ing for arivi taking examinations. Certain findings seem to be 
clear. First, tesjt coaching is not a waste of time. Students of a 
wide range of abilities have been shown to profit from certain 
kinds of coaching programs. The consensus ton measurement 
experts is that the mure disadvanuiged and deficient a student's 
background, the greater the impact of test coaching. Yet the 
data also suggest that medical students as well as educationally 
impoverished minority high school ttudems shov positive ef- 
fects from coaching. 

• Test wiseness strategies present a more complex situa- 
tion that is harder to summarize. High-scoring students report 
using some strategies to good effect. A presumed mech^^wism 
accounts for at leas: parr of the test wiseness effect, a student s 
sensitivity to trie varioui> cues to the correct answer left by un- 
pracl-'ced item writers. Test wise students apparentl) use these 
cuits to gain an advantage. To some extent, then, the strategies 
take advantage of certain errors in item construction and mea- 
surement. In addition, the test \ -ise student, when taking an 
exam, seems io use a large bod> of accepted techniques of time 
use, skipping, and so on. Test wise students also seem to take 
risks and make guoses. Both the sensitivity to cues and the test 
taking techniques appear to be teachable. It is not yet rlear 
whether a teacher can impart the judgment or w isdom to know 
which ^tniteg) to appl) in a given instance, or the willingness 
to use it. 



E KJ^C paring for am! Taking Tests 342 327 



Finally, we reviewed the status of test anxiety as an as- 
pect of test preparation and test taldng. Test anxiety has been 
identified and studied for;nore than three decades. In that per- 
iod, research on the identification and treatment of the test anx- 
ious student has moved apace. It is now possible to teach 
students how to avoid the personal effects of anxiety, and to 
teach instructors how to arrange testing to reduce the likeli- 
hood that anxiety will affect test scores. 

How might reading and study skills professionals use the 
information presented here? Perhaps by incorporating it into 
work with an individual student, or by creating a test prepara- 
tion unit in a class, or by developing a systematic program that 
is open to a wide audience. In any case, the actual form of the 
program will depend on the nature of the students, the needs of 
the institution, and the resources available. What follows is a 
set of suggested components for any program. Some of the sug- 
gestions are strongly supported by research evidence. L thers 
are based on our own clinical and teaching experience. 

Study Skills 

Most test preparation programs assume that students 
know how to study and, in fact, have done so. If there is any 
reason to think otherwise, the program must ha\e a study skills 
component. The literature on stuu/ skills instruction and on 
specific techniques for reading and studying textbook material 
is summarized elsewhere in this volume. Without reiterating 
here, we can say that certain specific study skills seem appropri- 
ate for the special process of test preparation. Preparation for an 
exam should mclude instruction in the following areas: 

• Time scheduling 

Setting personal priorities 

Setting aside time for review and practice 

• Spaced vs. massed review 

Massed sessions for reading and integration 
Spaced time for new material and nf-Otor learning 
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• Memory 

Imagery and association techniques 

Mnemonic systems 

Effects of recitation on retention. 

• Effects of stressors on test performance 

Sleep loss 
Drags 

Test anxiety 

Content Review 

The review of successful test preparation programs is 
consistent on one point. Good programs are not simple content 
cram courses. They must be planned as an integrated package of 
experiences. In most cases, the presentation team is an interdis- 
ciplinary one. A reading and study skills specialist will present 
the study skills material and the test wiseness strategies. De- 
pending on staff make-up, either the study skills specialist or a 
psychologist will help students learn techniques to reduce test 
anxiety But there must also be a subject natter expert (SME) on 
the team. 

The SME must be knowledgeable both in the content area 
of the test and in the techniques of teaching the subject. Such a 
person must know where students typically have trouble. If it is 
with the conceptual aspect, the SME must be prepared to offer 
important ideas at a more basic level. If the problem is computa- 
tional, there must be drill and guidance to make the applica- 
tions clear. If the problems are perceptual, the SME must teach 
the necessary discriminarJons that a competent student should 
demonstrate. The study skills specialist may be the expert in 
memory techniques or in planning spruced versus massed re- 
views or group study sessions to go over facts, but the SMF. has 
to limit and define those concepts and facts. 

Test Practice and Test Taking 

The coUection of suggestions for taking exams is vast. 
This chapter has reviewed the impact and value of many of 
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them. Which techniques to teach in a particular situation is a 
decision for the readin , and study skills specialist. However; the 
following categories do seem to be generally valuable: 

• Use of time 

Read all directions 

Plan time for review at the end 

Skip difficult items and go back to them 

Change any answer if it seems appropriate to do so 

• Guessing 

If there is no penalty for wrong answers, guess 
Even if there is a penalty, if one or more alternatives 
can be eliminated, guess 



Beyond these general rules, instructoi^s can find a body 
of more or less validated strategies that apply to specific '*em 
types. There is, for example, a set of strategies for the various 
objective items in general, for Type K items, for matching items, 
and for analogies (Flippo, 1988). A similar body of suggestions 
exists for approaching and answering essay questions. Some of 
the suggestions are conventional; write neatly (Marshall & 
Powers, 1969; Raygor & Wark, 1980); and avoid spelling, gram- 
mar, and punctuation errors, which can result in lower scores 
(Scannell & Marshall, 1966). Note, however, that within certain 
limits, the lower the legibility of an answer, the higher the grade 
(Chase, 1983). Other suggestions are more complex, involving 
an attempt to train students in patterns of precise thinking and 
organization. This discussion is not the place for those details. 
Howevei; some excellent sources on this topic are available. 
They should be consulted for management procedures (Flippo, 
1984) and specific examples to illustrate techniques. The v/orks 
by Boyd (1988), Ellis (1985), l^Hppo (1988), Millman and Pauk 
(1969), Pauk (1984), Raygor and Wark (1980), and Sherman and 
Wildman (1982) are all appropriate for postsecondary and col- 
lege students. 
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Test Anxiety 

What can we conclude about the most effective wa}^ to 
reduce test anxiety and increase grades for college students? 
The research literature has some clear suggestions (see espe- 
cially Hembree, 1988). A good program will include as many as 
possible of the following specific components: 

1. Self-controlled systematic desensitization. Teach 
deep muscle relax; ion, using the scrpt in Wolpe 
(1969) or any of ^'Tious commercial audiotapes. 
While they are relaxed, have students imagine them- 
selves going througli the steps of study, and finally 
going into the exam. Have the students tell them- 
selves to be calm while imagining being in the exam 
room. Have them direct themselves through the test 
wiseness steps they know. Relaxation and desensi- 
tization are important, but the major benefit proba- 
bly comes from calm students giving themselves 
instructions. 

2. Cognitive self-instruction training. Teach students to 
be awa^re of any negative internal self-talk and to 
counter it with self-support. Have students practice a 
self-instructional script that contains instructions to 
relax, to give reminders of material studied, to use 
test wiseness strategies, to focus on exam items, and 
to give gende self-support. 

3. Behavior self-control techniques. Have students se- 
lect a specific place for study and write precise goals 
for time and number of pages to read or problems to 
solve. Keep a chart of the number of hours spent in 
study and the goals met. Contract for rewards to be 
taken only when the goals are met. The payoff may 
be tangible or just supportive self-statements. 

4. Study skills instruction. This intervention is impor- 
tant for students who are anxious and who lack good 
study skills. Teach the student to do a prestudy Sur- 
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vey, ask Questions about the content, Read for the an- 
swers to the questions, Recite the answers from 
memory, and Review all the previous questions and 
answers. This widely accepted plan was developed 
by Robinson (1946); however, there are many accept- 
able variations to SQ3R. Always be cautious in teach- 
ing the Question step, no matter what it is called. 
Students will learn the answers to their questions, 
even if they are wrong (Wark, 1965). 

5. Test wiseness instruction. Anxious students should 
be taught a checklist of steps to recall during a test 
(e.g., plan time, eliminate similar options, look for as- 
sociations, look for specific determiners). But notr 
that the literature gives no support for test wiseness 
training as an isolated treatment. Instruction in test 
wiseness seems to work only when combined with 
other interventions. 

Some institutions may be planning a structured program 
to combat test anxiety. The suggestions discussed earlier should 
enable study skills teachers with some background in psychol- 
ogy to set up an effective antianxiety program. For those read- 
ers who want more details, two articles in the literature review 
(Mitchell & Ng, 1972; Mitchell et ^, 1975) give complete de- 
scriptions of their ireatment groups. Wark et al. (1981) give de- 
tails of an effective treatment program for students who are 
anxious when doing study-type reading and get low scores on 
their reading comprehension. 

Some teachers may v/ant to screen a class to pick out the 
students who are at risk for test anxiety. Those students identi- 
fied by the screening can be referred for group or individual 
attention. For such screening purposes, the best instrument is 
probably the Anxiety Scale developed by Sarason and Ganzer 
(1962). Wark and Bennett (1981) recommend using a cutoff 
score of 1 1 or above as a sign of test anxiety. Either article can 
be consulted for a copy of the items, which may be used with- 
out permission. 
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Evaluating an individual for test anxiety is essentially a 
clinical activity. Test anxiety and study skills tests are helpful in 
this evaluation. Each gives some additional information that 
can lead to a diagnosis. Part of the process should be obtaining a 
history of school experiences and conducting a specific probe 
of recent anxiety experiences in test taking. 

Implications for Future Research 

Suggestions for further research in test preparation and 
test taking were implicit in many of the sources rj^viewed for 
this article. From an informal summary across the sources, two 
specific areas of concern seem to emerge. One is best character- 
ized as a broad educational focus. Anastasi (1981) notes that 
current research is focusing on the development of widely ap- 
plicable intellectual skills, work habits, and problem-solving 
strategies. The types of programs developed from this research 
would provide education rather than coaching or short term 
cramming to pass certain test items (Flippo & Borthwick, 
1982). Cheek, Flippo, and Lindsey (1989) suggest that test wise- 
ness training should begin in the elementary grades. 

In the same tradition, Coffman (1980) says there is some 
evidence that instruction in item-oriented problem solving ma) 
improvi' :he underlying skills a test is designed to assess. Fur- 
ther research could develop syst matic methods to improve not 
only test performance but also latent skills. This research 
should provide information about the detailed nature of these 
"deeper" abilities, along with the conditions under \v hich they 
may be expected to improve. One result of this research thrust 
could be tailored instruction to teach significant thinking skills 
that go beyond the strategies of test preparation and test taking 

If this broad type of suggested research can be called mo- 
lecular, the second trend in the literature is more atomic. The 
assumption is that instruction can be given to help students sim- 
ply become more test wise. Rickards and August (19^5) suggest 
that research is needed on better ways to teach such pretest 
strategies as underlining, organizing, and noteuking. But what 
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is the psychological basis for using these techniques? Weinstein 
and others (1980) look for research to refine our understanding 
of the covert processes involved in using cognitive strategies for 
learning and retention. Bondy (1978) suggests that further re- 
search be directed toward manipulating the variables within re- 
view sessions that are beneficial to students and efficient for 
instructors. 

The results of the molecular and the atomic approach to 
test research will be similar: the difference is in the hypotheses 
and methods used. If continued research can provide better 
strategies for test preparation, perhaps some of the negative as- 
pects of testing can be reduced. More important, test wiseness 
research may lead to new and important methods of teaching 
and learning. Tests will always be a fact of life for anyone mov- 
ing up the educational ladder. But it is interesting to consider 
how learning might change if much of the negative aspect of 
testing could be removed. 
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